Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.955056642s FAIL (2025-09-04 21:33:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.955156058s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 3.172100998s FAIL (2025-09-04 21:33:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.172148212s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.858190347s FAIL (2025-09-04 21:32:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.858210506s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.787032597s FAIL (2025-09-04 21:31:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.78713758s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.608428851s FAIL (2025-09-04 21:31:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.608459197s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.707066809s FAIL (2025-09-04 21:30:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.707099311s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.845392339s FAIL (2025-09-04 21:29:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.845428462s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.642180297s FAIL (2025-09-04 21:28:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.642213778s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.913218772s FAIL (2025-09-04 21:28:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.913267408s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.918376035s FAIL (2025-09-04 21:27:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.919543628s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001923043s FAIL (2025-09-04 21:27:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001971931s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.859242193s FAIL (2025-09-04 16:48:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.85935164s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.445014919s FAIL (2025-09-04 16:47:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.445052384s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.445721472s FAIL (2025-09-04 16:46:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.445754796s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.698830174s FAIL (2025-09-04 16:45:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.698870144s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.262501151s FAIL (2025-09-04 16:44:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.262546235s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.356807105s FAIL (2025-09-04 16:43:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.356834957s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.502166248s FAIL (2025-09-04 16:43:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.502196934s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.434801064s FAIL (2025-09-04 16:43:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.434845817s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.493778708s FAIL (2025-09-04 16:42:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.493812618s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.839888232s FAIL (2025-09-04 16:41:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.839929884s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.420171731s FAIL (2025-09-04 16:40:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.42020103s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.355641955s FAIL (2025-09-04 16:39:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.355697703s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.629556856s FAIL (2025-09-04 16:39:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.629592402s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.397542769s FAIL (2025-09-04 16:38:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.397583956s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.400059079s FAIL (2025-09-04 16:37:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.400157052s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.426673454s FAIL (2025-09-04 16:36:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.426711167s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 3.104293433s FAIL (2025-09-04 16:35:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 3.104346749s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.510594129s FAIL (2025-09-04 16:34:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.510623266s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.421011474s FAIL (2025-09-04 16:33:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.421044902s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.34028636s FAIL (2025-09-04 16:32:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.340357882s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.562293396s FAIL (2025-09-04 16:32:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.562348319s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.452201752s FAIL (2025-09-04 16:31:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.452238394s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.38359079s FAIL (2025-09-04 16:30:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.383633304s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.558389956s FAIL (2025-09-04 16:29:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.55844452s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.560623319s FAIL (2025-09-04 16:28:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.560662278s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.416560208s FAIL (2025-09-04 16:27:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.416593204s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.528183398s FAIL (2025-09-04 16:26:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.528219764s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.512923114s FAIL (2025-09-04 16:25:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.512965418s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.789203031s FAIL (2025-09-04 16:25:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.789234235s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.782800584s FAIL (2025-09-04 16:24:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.782830187s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.397859117s FAIL (2025-09-04 16:23:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.397896193s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.580926859s FAIL (2025-09-04 16:22:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.581012242s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.391955455s FAIL (2025-09-04 16:21:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.391997289s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 3.27396279s FAIL (2025-09-04 16:20:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 3.274002223s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.424380334s FAIL (2025-09-04 16:20:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.424435264s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.419500456s FAIL (2025-09-04 16:19:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.419533722s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.674977694s FAIL (2025-09-04 16:18:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.675055077s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.383917533s FAIL (2025-09-04 16:18:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.383951123s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.640404485s FAIL (2025-09-04 16:17:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 4 16:02:42.909719129 (145h55m3.402151563s) [upload=128456]: Starting upload Sep 4 16:02:42.909796536 (145h55m3.402228978s) [upload=128456]: Done starting upload Sep 4 16:02:42.909970029 (145h55m3.402402466s) [upload=128456]: Uploading segments... Sep 4 16:02:42.910279905 (145h55m3.402712347s) [upload=128456]: Got next segment. Inline: false Sep 4 16:02:42.910327706 (145h55m3.402760153s) [upload=128456]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 4 16:02:42.910334234 (145h55m3.402766684s) [upload=128456]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 4 16:02:43.030362651 (145h55m3.522795101s) [seg_pos={0 0}, upload=128456]: Begin upload segment... Sep 4 16:02:43.030428427 (145h55m3.522860873s) [seg_pos={0 0}, upload=128456]: Done begin upload segment. Sep 4 16:02:43.030481197 (145h55m3.522913646s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030491260 (145h55m3.522923712s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.030637146 (145h55m3.523069594s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031039875 (145h55m3.523472328s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031052847 (145h55m3.523485298s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031473422 (145h55m3.523905873s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031487613 (145h55m3.523920067s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.031942053 (145h55m3.524374506s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032440371 (145h55m3.524872823s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.032857734 (145h55m3.525290184s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033263504 (145h55m3.525695956s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.033651092 (145h55m3.526083522s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034034716 (145h55m3.526467276s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034404674 (145h55m3.526837127s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.034763408 (145h55m3.527195842s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.042130641 (145h55m3.53456307s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Uploading piece... Sep 4 16:02:43.142071932 (145h55m3.634504383s) [noise=true , address=77.90.31.16:4733 , piece_id=YRXPBCNEYLXLHHTAQ5CICHWNQ53VOOGQRHJURRGHTKM66SFMXALQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: write tcp 139.59.144.22:45412->77.90.31.16:4733: write: connection refused; conn closed: op Sep 4 16:02:43.649162898 (145h55m4.14159534s) [upload=128456]: Next returned nil segment Sep 4 16:02:43.649201552 (145h55m4.141633994s) [upload=128456]: Waiting for error group managing segments... Sep 4 16:02:43.787153228 (145h55m4.279585661s) [noise=true , address=45.91.116.12:4226 , piece_id=GCDHGJXTWPEYH5ZA4LUZX35JIYT7SGNZUWNIQNNKONU67UT6MYVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.794033433 (145h55m4.286465869s) [noise=true , address=77.90.31.14:4662 , piece_id=Q7HU2WZ2C2QWQWHFR74FRNZQ67JECTP67JVCTV5VYJFR7NNBEMVA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.797370363 (145h55m4.289802805s) [noise=true , address=45.91.116.5:4297 , piece_id=2XX3YAVK2QQBKVAX4ACNAPRHOKFG5IZMPDGJNUX6REULDZQYVWUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.800401208 (145h55m4.292833644s) [noise=true , address=45.91.116.7:4011 , piece_id=RFKP3SAEJHQKFY7WTYEXY2ZTDM62DIZ56EAFG6EFSAI5KHOA66LA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.802148843 (145h55m4.294581287s) [noise=true , address=45.91.116.5:4299 , piece_id=G7I2KD76ZF67MIQ4Q64SMBLALPTH5OPMJ4DXLH2W4RJXK3XJLTZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.806652318 (145h55m4.299084746s) [noise=true , address=45.91.116.11:4118 , piece_id=4QJJBZX7GMEJUFOOOHEVC7I5USDDU7XWRT4GVFJGJJHZNQGX444A, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.809158593 (145h55m4.301591024s) [noise=true , address=45.91.116.13:4153 , piece_id=K5XSNOYMSMKYGGF2BBQVNFGPTKECW3UWLLMTEM3K3G4GEWBWCGQA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.815930422 (145h55m4.308362866s) [noise=true , address=45.91.116.4:4938 , piece_id=OQEE2FHNCWZBD6LRZL7VWLLTBXN5LSQYDNE2OX57Z4UUI5CIHHHA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.816434663 (145h55m4.308867097s) [noise=true , address=45.91.116.4:4939 , piece_id=YZ5NE5WC5SVLEJG4KVKENJPZODUECGKM7CQ6BYU3B6OBZV7IK4RA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.823376139 (145h55m4.315808574s) [noise=true , address=45.91.116.12:4225 , piece_id=6EJGEBNHULNADMZ5NVBXWYNENHPSMZCTCMB2Y2W2OEYYQYOGNZUQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.828695794 (145h55m4.321128229s) [noise=true , address=45.91.116.11:4117 , piece_id=YFZOLJMOVQUL6JWW4XQTSRUW7BJJS73IIUZ2ZLIVG4A3KS3ER7XQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:43.837433498 (145h55m4.329865935s) [noise=true , address=77.90.31.12:4592 , piece_id=LL2QYC5K6DMLRBVVNFSA4SEFVEI2P3TKDDAN75FJKKITJ6SR2S6Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: <nil> Sep 4 16:02:55.067986508 (145h55m15.560418954s) [noise=true , address=77.90.31.15:4697 , piece_id=4DJYLDGDAMZGBROAAIMAFCYAEFXY7Q5HM2QHSTYALGB4T2HRGIZA, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:51706->77.90.31.15:4697: read: connection reset by peer; conn closed: op; piecestore: piecestore close: conn closed: op Sep 4 16:03:12.597282068 (145h55m33.0897145s) [noise=true , address=77.90.31.19:4842 , piece_id=NAY24XIAA4QPF5XVCIXRXXABLQYSQJZXDBKGBCJLEIG32KGHAS2Q, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597421723 (145h55m33.089854166s) [noise=true , address=77.90.31.19:4841 , piece_id=6ES56EBISG2F5LBC6CTGL5DO4XG4YJ566EJMJP3YTK2POM7BNWGQ, seg_pos={0 0}, upload=128456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: context deadline exceeded; context deadline exceeded Sep 4 16:03:12.597445781 (145h55m33.089878226s) [seg_pos={0 0}, upload=128456]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 4 16:03:12.723001789 (145h55m33.215434225s) [upload=128456]: Done uploading segments... Sep 4 16:03:12.723050678 (145h55m33.215483121s) [upload=128456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.640441096s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)