Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.784136168s
FAIL (2025-07-22 22:36:39 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.784164901s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.437091453s
FAIL (2025-07-22 22:36:33 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.437119741s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.325415792s
FAIL (2025-07-22 22:36:14 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.325448335s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.418092244s
FAIL (2025-07-22 22:35:59 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.418198126s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.717167881s
FAIL (2025-07-22 22:35:35 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.71719695s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.633254704s
FAIL (2025-07-22 22:35:16 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.633283312s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.388515548s
FAIL (2025-07-22 22:34:53 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.388559808s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.584810501s
FAIL (2025-07-22 22:34:50 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.584863625s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.496029733s
FAIL (2025-07-22 22:33:58 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.496068797s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.398675497s
FAIL (2025-07-22 22:33:47 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.398705313s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.219777178s
FAIL (2025-07-22 22:33:34 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.219808734s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
3.216991872s
FAIL (2025-07-22 22:33:18 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.217061473s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.796866063s
FAIL (2025-07-22 22:32:19 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.796899851s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
3.049559201s
FAIL (2025-07-22 22:32:18 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.049606801s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
3.976263676s
FAIL (2025-07-22 22:31:14 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.976295148s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.559532099s
FAIL (2025-07-22 22:31:11 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.559561495s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
3.095582853s
FAIL (2025-07-22 22:30:42 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.095614088s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.833060215s
FAIL (2025-07-22 22:30:06 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.833097819s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.771686507s
FAIL (2025-07-22 22:29:51 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.771729015s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
3.592137774s
FAIL (2025-07-22 22:29:29 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.592164652s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.796788958s
FAIL (2025-07-22 22:29:19 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.796825843s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.795684846s
FAIL (2025-07-22 22:28:48 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.795728726s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
3.402351207s
FAIL (2025-07-22 22:28:46 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.402379923s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.932386121s
FAIL (2025-07-22 22:28:00 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.932420504s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
3.197816157s
FAIL (2025-07-22 22:27:50 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.197862722s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.547085171s
FAIL (2025-07-22 22:27:42 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.547120469s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
3.14756365s
FAIL (2025-07-22 22:27:18 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.147614622s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.701805989s
FAIL (2025-07-22 22:26:52 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.701848637s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.939536098s
FAIL (2025-07-22 22:26:09 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.939576817s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.600711316s
FAIL (2025-07-22 22:25:53 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.605520586s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.524588912s
FAIL (2025-07-22 22:25:37 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.524615503s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
3.206394587s
FAIL (2025-07-22 22:25:18 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.206427325s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.484332155s
FAIL (2025-07-22 22:24:54 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.484369257s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.634863477s
FAIL (2025-07-22 22:24:33 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.634900561s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.364629947s
FAIL (2025-07-22 22:24:23 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.364728881s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.298769964s
FAIL (2025-07-22 22:23:50 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.298796774s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
3.261522832s
FAIL (2025-07-22 22:23:37 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.261614057s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.541298298s
FAIL (2025-07-22 22:23:21 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.541325833s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.371295169s
FAIL (2025-07-22 22:22:57 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.371328561s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
3.423797925s
FAIL (2025-07-22 22:22:56 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.42385164s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.439235526s
FAIL (2025-07-22 22:22:25 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.439365417s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
3.231576307s
FAIL (2025-07-22 22:21:56 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.23160859s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
3.932213101s
FAIL (2025-07-22 22:21:40 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.932254121s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.518909861s
FAIL (2025-07-22 22:21:28 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.518931202s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
4.817708564s
FAIL (2025-07-22 22:20:43 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 4.81773879s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.458193847s
FAIL (2025-07-22 22:20:14 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.458303459s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
3.397385856s
FAIL (2025-07-22 22:20:02 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.397445264s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.634038877s
FAIL (2025-07-22 22:19:57 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.634073949s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.846094999s
FAIL (2025-07-22 22:18:57 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.846119363s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.636545307s
FAIL (2025-07-22 22:18:54 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.636576533s
core
uplink
us1
|