hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chance Li (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted
Date Thu, 08 Mar 2018 10:17:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391023#comment-16391023
] 

Chance Li commented on HBASE-19389:
-----------------------------------

[~uagashe], Thanks, sir. 

I should re-write javadoc or comments of the patch, it's really not good.  I will update
it soon.

> Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted
> -----------------------------------------------------------------------------------------
>
>                 Key: HBASE-19389
>                 URL: https://issues.apache.org/jira/browse/HBASE-19389
>             Project: HBase
>          Issue Type: Improvement
>          Components: Performance
>    Affects Versions: 2.0.0
>         Environment: 2000+ Region Servers
> PCI-E ssd
>            Reporter: Chance Li
>            Assignee: Chance Li
>            Priority: Critical
>             Fix For: 2.0.0
>
>         Attachments: CSLM-concurrent-write.png, HBASE-19389-branch-2-V2.patch, HBASE-19389-branch-2-V3.patch,
HBASE-19389-branch-2-V4.patch, HBASE-19389-branch-2-V5.patch, HBASE-19389-branch-2-V6.patch,
HBASE-19389-branch-2-V7.patch, HBASE-19389-branch-2-V8.patch, HBASE-19389-branch-2.patch,
metrics-1.png, ycsb-result.png
>
>
> In a large cluster, with a large number of clients, we found the RS's handlers are all
busy sometimes. And after investigation we found the root cause is about CSLM, such as compare
function heavy load. We reviewed the related WALs, and found that there were many columns
(more than 1000 columns) were writing at that time.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message