Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
3.932213101s
FAIL (2025-07-22 22:21:40 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.932254121s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.518909861s
FAIL (2025-07-22 22:21:28 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.518931202s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
4.817708564s
FAIL (2025-07-22 22:20:43 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 4.81773879s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.458193847s
FAIL (2025-07-22 22:20:14 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.458303459s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
3.397385856s
FAIL (2025-07-22 22:20:02 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.397445264s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.634038877s
FAIL (2025-07-22 22:19:57 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.634073949s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.846094999s
FAIL (2025-07-22 22:18:57 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.846119363s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.636545307s
FAIL (2025-07-22 22:18:54 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.636576533s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
3.246436553s
FAIL (2025-07-22 22:18:19 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.246471145s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.424755925s
FAIL (2025-07-22 22:17:50 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.424785004s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
3.203715017s
FAIL (2025-07-22 22:17:28 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.203741872s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
3.137750812s
FAIL (2025-07-22 22:16:52 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.137777978s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.470829916s
FAIL (2025-07-22 22:16:41 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.470865658s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
3.144468452s
FAIL (2025-07-22 22:16:09 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 3.144574512s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.314917832s
FAIL (2025-07-22 22:15:57 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.314942946s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.575522828s
FAIL (2025-07-22 22:15:26 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.575554792s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.681005197s
FAIL (2025-07-22 22:15:05 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.681038381s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.87899831s
FAIL (2025-07-22 22:14:43 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.879038979s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.306556169s
FAIL (2025-07-22 22:14:16 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.306593431s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.283402917s
FAIL (2025-07-22 22:13:57 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.283430229s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.625824155s
FAIL (2025-07-22 22:13:32 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 2.625844821s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.000444005s
FAIL (2025-07-22 22:13:29 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
in
Jul 22 22:11:44.071257707 (95h21m10.98836271s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 22 22:11:44.273134528 (95h21m11.190239541s) [seg_pos={0 0}, upload=76276]: Begin upload segment...
Jul 22 22:11:44.273207776 (95h21m11.19031277s) [seg_pos={0 0}, upload=76276]: Done begin upload segment.
Jul 22 22:11:44.273274759 (95h21m11.190379762s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273286917 (95h21m11.190391921s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273772977 (95h21m11.190877968s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.273850584 (95h21m11.190955587s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274160322 (95h21m11.191265329s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274363746 (95h21m11.19146875s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274461129 (95h21m11.191566123s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274754478 (95h21m11.191859481s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.274812369 (95h21m11.191917411s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275077466 (95h21m11.192182472s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275143339 (95h21m11.192248342s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275396210 (95h21m11.192501216s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275475988 (95h21m11.192580996s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275731546 (95h21m11.192836552s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.275803970 (95h21m11.192908977s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276095275 (95h21m11.193200281s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276499385 (95h21m11.193604392s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.276996124 (95h21m11.194101113s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Uploading piece...
Jul 22 22:11:44.828385153 (95h21m11.745490194s) [upload=76276]: Next returned nil segment
Jul 22 22:11:44.828409703 (95h21m11.745514716s) [upload=76276]: Waiting for error group managing segments...
Jul 22 22:11:44.980248240 (95h21m11.897353233s) [noise=true , address=77.90.31.21:4893 , piece_id=JVZCI77GULGUZVR6HIDUDAFIGEFRTWGHDS2TNKN3K7JOZ3DW5CQA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.993975610 (95h21m11.911080607s) [noise=true , address=77.90.31.11:4558 , piece_id=2TP5XAQQCR7DU2I6RZUOYGXR5GFABI2FCWM7CNIQQUVMVF36CPYQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996295967 (95h21m11.913400956s) [noise=true , address=45.91.116.7:4035 , piece_id=CX3AWTVT6UANKHKHSUE4J66AZLO3BW5CNOVFC7A7SEP27WRJSQKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.996582585 (95h21m11.913687582s) [noise=true , address=45.91.116.10:4109 , piece_id=SAA3LA2DGQNYQVVG4N4S3IYSS3453DAYMGQKXJLYBV7K2HMUDPBQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.997053325 (95h21m11.914158319s) [noise=true , address=77.90.31.17:4787 , piece_id=KHEXQAYQK2C53HXDPRE42GHLJXJE2VTAKGQF4X7HKKIVZH2RDGCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:44.998100367 (95h21m11.915205364s) [noise=true , address=45.91.116.12:4252 , piece_id=KVSY5RNXY73BG643CXPJUJ3QDBEAB64IDYHK77GKD4SL2ALIN7WA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.032070104 (95h21m11.949175097s) [noise=true , address=104.36.82.6:4896 , piece_id=U3G4EQUTP4ML7BNAJC37QF4LAR4DWEPLJZ7SOJ3HGDETFTSWLAKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.043980011 (95h21m11.961085021s) [noise=true , address=104.36.82.21:4497 , piece_id=BEWXZNQQQILUMAH4ANZFMUWUL6NNXB7C2RF5IVLFKGAE3YOQX2TA, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.052980886 (95h21m11.970085881s) [noise=true , address=104.36.82.7:4915 , piece_id=V4X6RELAX3LTFDYX2W4IDZBCM6XK65OE5NA53F4HQGYYOX5OVZSQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.062781703 (95h21m11.979886696s) [noise=true , address=104.36.82.12:4184 , piece_id=NVEPSUSMQBLQXWHR4E5FCBAC5QCJOVKJGGCB4WQSMGGE7SSYX4QQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.094333431 (95h21m12.011438434s) [noise=true , address=79.127.219.48:4091 , piece_id=KZCZKAM2NTC2AVS6KKA3VW5AORQIXM56NUZT72VPGA6WSOU42ESQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.110371440 (95h21m12.02747643s) [noise=true , address=45.91.116.4:4958 , piece_id=WRSOMZXM2KOUSE4RFZ55UIAKVAGR3GST7YBHTJA6ZQP2LTJEUFRQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.172432826 (95h21m12.089537819s) [noise=true , address=79.127.220.98:4410 , piece_id=3J3CVN36XLF4UHAYJV7GNUNCX4ZTNJYJV6NPZK3GSLLBVU3Y2HKQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222021746 (95h21m12.139126737s) [noise=true , address=104.36.82.51:4073 , piece_id=Z2KL2K4FYLAH2D6FEJOFVXI3YWOOZBY3WXF7MW4SKFJBIMU5QPCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: <nil>
Jul 22 22:11:45.222050604 (95h21m12.139155607s) [seg_pos={0 0}, upload=76276]: Segment reached optimal threshold of 14 pieces.
Jul 22 22:11:45.222294641 (95h21m12.139399639s) [noise=true , address=79.127.220.101:4047 , piece_id=CW6MUPCICGAXHC4Z65X5RZL34LDXLL3VWT2GON4DYKVQ3W3EZSCQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cTrLBz3rSahRJUunES9KYfhcEPHbcxnNimnPeiVR3BH7Ht1yV): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222362575 (95h21m12.139467585s) [noise=true , address=104.36.82.15:4267 , piece_id=BZVDNHG3XSNOGLG2KJXJ5C5AWUFGLMI7EHNES4DQIDZG2AYL3Z6Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF
Jul 22 22:11:45.222447312 (95h21m12.139552305s) [noise=true , address=79.127.205.234:4619 , piece_id=MITWGG3KF36AVYRCYTU3D3GQPKGMYMSXYKIU7F6UWWGMIAM5JP5Q, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42066->79.127.205.234:4619: use of closed network connection
Jul 22 22:11:45.222571004 (95h21m12.139676011s) [noise=true , address=79.127.205.246:4284 , piece_id=6OJSPLQVERDLIEJZNWEWPZDEK5FN2UXIO2OGBP3ZB2SZ3JMURXHQ, seg_pos={0 0}, upload=76276]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60456->79.127.205.246:4284: use of closed network connection
Jul 22 22:11:45.222605302 (95h21m12.13971031s) [seg_pos={0 0}, upload=76276]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 22 22:11:45.222748342 (95h21m12.139853349s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 22 22:11:45.222754997 (95h21m12.139860007s) [upload=76276]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 22 22:11:45.377219329 (95h21m12.29432434s) [upload=76276]: Done uploading segments...
Jul 22 22:11:45.377239514 (95h21m12.29434452s) [upload=76276]: Upload finished. err: <nil>
Duration: 1m0.000468698s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.579363356s
FAIL (2025-07-22 22:13:04 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.579413744s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.25120309s
FAIL (2025-07-22 22:12:08 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.251235706s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.124311943s
FAIL (2025-07-22 22:11:25 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.124341983s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.650336321s
FAIL (2025-07-22 22:11:01 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.650370048s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.0009994s
FAIL (2025-07-22 22:10:58 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 30.001018558s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
17.311557401s
FAIL (2025-07-21 23:47:16 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 17.311590168s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
3.143130242s
FAIL (2025-07-21 23:45:56 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.143159598s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
3.001634248s
FAIL (2025-07-21 23:45:02 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.001729631s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
18.061538172s
FAIL (2025-07-21 23:44:43 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 18.06156424s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
3.198018946s
FAIL (2025-07-21 23:43:16 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.198046108s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
13.362360685s
FAIL (2025-07-21 23:43:03 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 13.362410505s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
3.102435439s
FAIL (2025-07-21 23:41:51 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.102460503s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.749255549s
FAIL (2025-07-21 23:41:21 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.749342807s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.688128934s
FAIL (2025-07-21 23:40:38 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.688156002s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.988483953s
FAIL (2025-07-21 23:40:10 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.988520077s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
15.03642899s
FAIL (2025-07-21 23:39:09 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 15.03645774s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
14.453462287s
FAIL (2025-07-21 23:38:08 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 14.453494933s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
3.271994414s
FAIL (2025-07-21 23:37:04 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.272033439s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
10.663007361s
FAIL (2025-07-21 23:36:33 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 10.663019789s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
12.041204803s
FAIL (2025-07-21 23:35:31 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 12.04122755s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
35.821782509s
FAIL (2025-07-21 23:34:47 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 35.821808412s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
3.279260976s
FAIL (2025-07-21 23:33:22 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.279290671s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
15.176937511s
FAIL (2025-07-21 23:32:58 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 15.176963631s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
18.32602573s
FAIL (2025-07-21 23:32:39 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 18.326046448s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
3.658562265s
FAIL (2025-07-21 23:31:50 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.658597825s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.991207921s
FAIL (2025-07-21 23:30:39 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.991228176s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.759894628s
FAIL (2025-07-21 23:29:52 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.759920119s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
6.00593258s
FAIL (2025-07-21 23:29:39 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.005968282s
core
uplink
us-select-1
us1-placement-20
|