Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [.....X..XXXXXXXXX.XX.X..X...................................] duration: 2.743182029s FAIL (2025-09-19 20:49:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.743330929s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [.....XXXXXXXXX....XX..XX....................................] duration: 2.863455512s FAIL (2025-09-19 20:49:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.863484732s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [......X..XXXXXXXXX.XX.X..X..................................] duration: 2.550103267s FAIL (2025-09-19 20:48:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.550138092s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [......XXXXXXXXX....XX..XX...................................] duration: 2.667315856s FAIL (2025-09-19 20:48:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.667342825s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [.......XXXXXXXXX....XX..XX..................................] duration: 3.138027489s FAIL (2025-09-19 20:48:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.138061196s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [.......X..XXXXXXXXX.XX.X..X.................................] duration: 2.579833132s FAIL (2025-09-19 20:48:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.579933233s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [........X..XXXXXXXXX.XX.X..X................................] duration: 2.576866443s FAIL (2025-09-19 20:47:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.576896249s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [........XXXXXXXXX....XX..XX.................................] duration: 2.969973892s FAIL (2025-09-19 20:46:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.969997778s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [.........X..XXXXXXXXX.XX.X..X...............................] duration: 2.521439642s FAIL (2025-09-19 20:46:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.521477552s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [.........XXXXXXXXX....XX..XX................................] duration: 2.953278414s FAIL (2025-09-19 20:46:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.953307652s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [..........X..XXXXXXXXX.XX.X..X..............................] duration: 2.460835514s FAIL (2025-09-19 20:45:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.460868251s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [..........XXXXXXXXX....XX..XX...............................] duration: 2.724215514s FAIL (2025-09-19 20:45:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.724242878s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [...........X..XXXXXXXXX.XX.X..X.............................] duration: 2.716654905s FAIL (2025-09-19 20:44:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.716694817s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [...........XXXXXXXXX....XX..XX..............................] duration: 2.881610279s FAIL (2025-09-19 20:44:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.881633349s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [............X..XXXXXXXXX.XX.X..X............................] duration: 2.526547006s FAIL (2025-09-19 20:43:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.52657753s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [.............X..XXXXXXXXX.XX.X..X...........................] duration: 2.453560328s FAIL (2025-09-19 20:43:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.453593296s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [..............X..XXXXXXXXX.XX.X..X..........................] duration: 2.731578849s FAIL (2025-09-19 20:43:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.731610167s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [............XXXXXXXXX....XX..XX.............................] duration: 2.772402505s FAIL (2025-09-19 20:42:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.772430234s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [...............X..XXXXXXXXX.XX.X..X.........................] duration: 2.713209408s FAIL (2025-09-19 20:42:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.71325018s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [.............XXXXXXXXX....XX..XX............................] duration: 2.967767225s FAIL (2025-09-19 20:42:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.969151418s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [................X..XXXXXXXXX.XX.X..X........................] duration: 2.556526571s FAIL (2025-09-19 20:41:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.556589219s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [..............XXXXXXXXX....XX..XX...........................] duration: 2.806242807s FAIL (2025-09-19 20:40:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.806271539s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [.................X..XXXXXXXXX.XX.X..X.......................] duration: 2.704012835s FAIL (2025-09-19 20:40:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.704043908s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [...............XXXXXXXXX....XX..XX..........................] duration: 2.833663101s FAIL (2025-09-19 20:40:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.833688335s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [..................X..XXXXXXXXX.XX.X..X......................] duration: 2.460916944s FAIL (2025-09-19 20:39:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.460946379s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [...................X..XXXXXXXXX.XX.X..X.....................] duration: 5.667498951s FAIL (2025-09-19 20:39:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 5.667538167s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [................XXXXXXXXX....XX..XX.........................] duration: 2.764151067s FAIL (2025-09-19 20:39:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.764247138s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [.................XXXXXXXXX....XX..XX........................] duration: 2.698028464s FAIL (2025-09-19 20:38:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.698049502s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [....................X..XXXXXXXXX.XX.X..X....................] duration: 2.676884821s FAIL (2025-09-19 20:38:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.676920249s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [..................XXXXXXXXX....XX..XX.......................] duration: 2.685004623s FAIL (2025-09-19 20:38:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.685033781s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [...................XXXXXXXXX....XX..XX......................] duration: 2.776563139s FAIL (2025-09-19 20:37:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.776613871s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [.....................X..XXXXXXXXX.XX.X..X...................] duration: 2.737145585s FAIL (2025-09-19 20:37:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.737196795s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [....................XXXXXXXXX....XX..XX.....................] duration: 2.812621518s FAIL (2025-09-19 20:36:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.813013899s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [......................X..XXXXXXXXX.XX.X..X..................] duration: 2.423603457s FAIL (2025-09-19 20:36:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.423638957s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [.......................X..XXXXXXXXX.XX.X..X.................] duration: 2.627117156s FAIL (2025-09-19 20:36:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.627158412s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [.....................XXXXXXXXX....XX..XX....................] duration: 2.781257833s FAIL (2025-09-19 20:36:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.781295514s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [......................XXXXXXXXX....XX..XX...................] duration: 2.736882824s FAIL (2025-09-19 20:35:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.736898541s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [........................X..XXXXXXXXX.XX.X..X................] duration: 2.722872579s FAIL (2025-09-19 20:34:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.7228987s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [.......................XXXXXXXXX....XX..XX..................] duration: 3.104305654s FAIL (2025-09-19 20:34:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.104342869s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [.........................X..XXXXXXXXX.XX.X..X...............] duration: 2.630517098s FAIL (2025-09-19 20:34:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.630540095s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [........................XXXXXXXXX....XX..XX.................] duration: 2.764688049s FAIL (2025-09-19 20:33:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.764710233s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [..........................X..XXXXXXXXX.XX.X..X..............] duration: 2.518049039s FAIL (2025-09-19 20:33:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.518077331s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [.........................XXXXXXXXX....XX..XX................] duration: 3.045068342s FAIL (2025-09-19 20:33:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.045103467s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [...........................X..XXXXXXXXX.XX.X..X.............] duration: 2.872309934s FAIL (2025-09-19 20:33:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.872351884s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [..........................XXXXXXXXX....XX..XX...............] duration: 3.000320856s FAIL (2025-09-19 20:32:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.000343667s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [...........................XXXXXXXXX....XX..XX..............] duration: 2.880613799s FAIL (2025-09-19 20:32:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.880650132s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [............................X..XXXXXXXXX.XX.X..X............] duration: 2.570780342s FAIL (2025-09-19 20:31:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.570810782s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 13 out of 60 is failed (threshold=3) [............................XXXXXXXXX....XX..XX.............] duration: 3.169474369s FAIL (2025-09-19 20:31:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.169869512s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [.............................X..XXXXXXXXX.XX.X..X...........] duration: 2.479647642s FAIL (2025-09-19 20:31:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.47968615s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [..............................X..XXXXXXXXX.XX.X..X..........] duration: 2.505771048s FAIL (2025-09-19 20:30:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 7) ======LOGS====== n Sep 19 20:22:50.102662820 (510h15m10.595095264s) [seg_pos={0 0}, upload=448856]: Begin upload segment... Sep 19 20:22:50.102722619 (510h15m10.595155062s) [seg_pos={0 0}, upload=448856]: Done begin upload segment. Sep 19 20:22:50.102750551 (510h15m10.595182996s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103190782 (510h15m10.595623231s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103509646 (510h15m10.5959421s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.103836285 (510h15m10.596268729s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104244391 (510h15m10.596676842s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104576441 (510h15m10.597008886s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.104941184 (510h15m10.597373631s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105304428 (510h15m10.597736873s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.105656379 (510h15m10.598088821s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106224032 (510h15m10.598656485s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.106687764 (510h15m10.599120214s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107080197 (510h15m10.599512642s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107408891 (510h15m10.599841343s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.107777408 (510h15m10.600209851s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108151816 (510h15m10.60058426s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.108465540 (510h15m10.600897982s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Uploading piece... Sep 19 20:22:50.732883115 (510h15m11.225315545s) [upload=448856]: Next returned nil segment Sep 19 20:22:50.732893407 (510h15m11.225325849s) [upload=448856]: Waiting for error group managing segments... Sep 19 20:22:50.877517094 (510h15m11.369949523s) [noise=true , address=145.79.227.6:4257 , piece_id=XFDALDBMOKBIVAXYL5EILTGUIZ63VTI766UAV4E3TRVC5BJ72LYA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.878502870 (510h15m11.370935313s) [noise=true , address=145.79.227.11:4729 , piece_id=PUYLJ6YC7RCS4EMRECHPWU5ZP5X32QSXAPPHVHAT7E5VNSK2OMXQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.884341437 (510h15m11.376773865s) [noise=true , address=145.79.227.4:4186 , piece_id=REAFHF5U3W5SQW4DSVFDW76DMFO5GVJCLOAIDWGMM2R23DRXF4RA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.890056744 (510h15m11.382489179s) [noise=true , address=145.79.227.17:4971 , piece_id=HLB4FCJNQQT2JSIHRAZ4QE4AW4DXP55SMGW3PF5UIFMSGCOZR74A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.893057011 (510h15m11.385489439s) [noise=true , address=145.79.227.18:4005 , piece_id=GCD62MFRZVI57D5XHXKKUCMB3Z7ATSBCYD7ZKBHR3VQX3JJBTSNA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.897882530 (510h15m11.390314966s) [noise=true , address=145.79.227.15:4873 , piece_id=R6T45TIWE2TWJ2OK7ZZHMWZVNYEIV5PN5QSMUXMN73RN2YKEGFQQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:22:50.906019627 (510h15m11.398452056s) [noise=true , address=145.79.227.14:4839 , piece_id=C6P6TEA3WU3D5RLR7JIGDQTIA3IW25WJQSNCZSIPKSEPQDNFRD2Q, seg_pos={0 0}, upload=448856]: Done uploading piece. err: <nil> Sep 19 20:23:19.696847719 (510h15m40.189280165s) [noise=true , address=45.91.116.10:4081 , piece_id=J2HFTS6GURXVDX7LUFNJANXL66YDYSOHHEZX6HU7F5PLFEKFC7KQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:46728->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696918229 (510h15m40.189350671s) [noise=true , address=77.90.31.19:4842 , piece_id=3UAFAGUVXME73AQA2WG7TMIIKRNJNEEZ4LBZEX7BFZNX7NWC2NPQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 139.59.144.22:49418->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.696973359 (510h15m40.189405802s) [noise=true , address=77.90.31.10:4517 , piece_id=B52JS5VGEWC7RKBVI4DI5CFYWUEJJWS6JTG2OY4UVGFVBCPDJJIA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 139.59.144.22:44372->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697023793 (510h15m40.189456228s) [noise=true , address=45.91.116.7:4009 , piece_id=OIAJ5EU4CW44PHYNDOKMLFQQ226C6MPAMKYFHKIOESYXITQE2VHA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:51982->45.91.116.7:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697077949 (510h15m40.189510391s) [noise=true , address=45.91.116.12:4225 , piece_id=QS7LEWFVLRU3ATOPBDPX7UCQWAPATAI6VYSMNQLHZA3U6JLBTCFQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: read tcp 139.59.144.22:56108->45.91.116.12:4225: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697122743 (510h15m40.189555185s) [noise=true , address=45.91.116.14:4189 , piece_id=HV6YRMRJXXN2W6SKXQNBXYBM23275QFCZNPANEWZ7U6QD6JLYD5A, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 139.59.144.22:57576->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697151202 (510h15m40.189583638s) [noise=true , address=45.91.116.6:4974 , piece_id=MCWDOVJQTUDENKGKJ3W4GWACOLLEDHVAJLNY2OY43BHIVLMLWAGA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: write tcp 139.59.144.22:59176->45.91.116.6:4974: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697194787 (510h15m40.189627229s) [noise=true , address=45.91.116.11:4117 , piece_id=A4PAAXKY6WPJJXDEZZ4EKUO3XSPKRIEDHCBKH3FYRLY4RGQQ4ALQ, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 139.59.144.22:41286->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:19.697245542 (510h15m40.189677992s) [noise=true , address=45.91.116.14:4190 , piece_id=PKGXK4NJ2V3K2VOCMPE7IZEGXUX6TFNEJOAZU66MCBINK6BV6JAA, seg_pos={0 0}, upload=448856]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 139.59.144.22:56168->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded Sep 19 20:23:19.697276993 (510h15m40.189709442s) [seg_pos={0 0}, upload=448856]: Done waiting for segment. successful: 7 optimal: 13 errs: <nil> Sep 19 20:23:19.804537315 (510h15m40.296969749s) [upload=448856]: Done uploading segments... Sep 19 20:23:19.804563258 (510h15m40.296995693s) [upload=448856]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 7) Duration: 2.50580031s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)