Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.742213628s
FAIL (2025-07-23 01:36:49 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.742305996s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.556764436s
FAIL (2025-07-23 01:35:53 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.556794534s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.740881499s
FAIL (2025-07-23 01:35:38 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.740931292s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.599108303s
FAIL (2025-07-23 01:35:00 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.599321253s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.659992408s
FAIL (2025-07-23 01:33:50 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.660043436s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.667876533s
FAIL (2025-07-23 01:32:38 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.667912482s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.629858704s
FAIL (2025-07-23 01:32:06 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.629883372s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.756808408s
FAIL (2025-07-23 01:31:20 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.756836128s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.510374729s
FAIL (2025-07-23 01:30:50 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.510626726s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.719325475s
FAIL (2025-07-23 01:30:08 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.719355631s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.706661605s
FAIL (2025-07-23 01:29:27 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.706685644s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.667800656s
FAIL (2025-07-23 01:28:49 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.668443976s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.922010393s
FAIL (2025-07-23 01:28:03 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.922078297s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.618943688s
FAIL (2025-07-23 01:27:15 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.618969597s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.714327627s
FAIL (2025-07-23 01:26:37 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.714358206s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.599614031s
FAIL (2025-07-23 01:25:45 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.599628824s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.838445078s
FAIL (2025-07-23 01:25:27 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.83848943s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.002113448s
FAIL (2025-07-23 01:24:49 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.002152958s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.704937707s
FAIL (2025-07-22 22:59:10 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.704969897s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
3.164430132s
FAIL (2025-07-22 22:58:22 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.164462334s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.74645003s
FAIL (2025-07-22 22:57:40 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.746473115s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.895252313s
FAIL (2025-07-22 22:57:17 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.895393898s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.449527447s
FAIL (2025-07-22 22:56:43 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.449558665s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.535317252s
FAIL (2025-07-22 22:55:48 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.535351752s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.513830916s
FAIL (2025-07-22 22:54:41 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.513859481s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.893490831s
FAIL (2025-07-22 22:53:31 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.893517799s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.972124109s
FAIL (2025-07-22 22:52:39 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.972159365s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.651842016s
FAIL (2025-07-22 22:51:25 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.651879018s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.274458258s
FAIL (2025-07-22 22:51:09 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.274487452s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.946552646s
FAIL (2025-07-22 22:51:06 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.946596584s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.208219812s
FAIL (2025-07-22 22:50:32 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.208255352s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.230757426s
FAIL (2025-07-22 22:50:10 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.230813649s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.878024965s
FAIL (2025-07-22 22:50:02 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.878059582s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
3.145285778s
FAIL (2025-07-22 22:49:28 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.145314548s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.161334216s
FAIL (2025-07-22 22:49:10 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.161365424s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.503290314s
FAIL (2025-07-22 22:48:40 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.503319s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.328708168s
FAIL (2025-07-22 22:48:39 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.328752379s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.69385687s
FAIL (2025-07-22 22:48:21 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.693898226s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.546534587s
FAIL (2025-07-22 22:48:16 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.546563941s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.370842596s
FAIL (2025-07-22 22:47:57 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.370878867s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.692191467s
FAIL (2025-07-22 22:47:35 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.692227522s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.731556032s
FAIL (2025-07-22 22:47:16 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.731580407s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.703206232s
FAIL (2025-07-22 22:46:48 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.703235717s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.393944601s
FAIL (2025-07-22 22:46:43 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.393978078s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
3.238957511s
FAIL (2025-07-22 22:46:15 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.239095141s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.417482666s
FAIL (2025-07-22 22:45:36 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.417511161s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
3.05209696s
FAIL (2025-07-22 22:45:05 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.052130404s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.233350658s
FAIL (2025-07-22 22:44:49 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.233381947s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
3.396000155s
FAIL (2025-07-22 22:44:20 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.396036869s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.691838916s
FAIL (2025-07-22 22:43:45 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.691870369s
core
uplink
us-select-1
us1-placement-20
|