hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yu Li (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-19389) RS's handlers are all busy when writing many columns (more than 1000 columns)
Date Fri, 01 Dec 2017 03:39:00 GMT

     [ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Yu Li updated HBASE-19389:
--------------------------
       Priority: Major  (was: Minor)
    Component/s:     (was: hbase)
                 Performance

This is something we found and resolved before Singles' Day and now running in production,
JFYI. Please let us know if any comments on the design of the patch or any better idea. Thanks.

[~chancelq] please wait another day for comments on design, then upload the patch to [review-board|https://reviews.apache.org/dashboard/]
for easier review. Thanks.

> RS's handlers are all busy when writing many columns (more than 1000 columns) 
> ------------------------------------------------------------------------------
>
>                 Key: HBASE-19389
>                 URL: https://issues.apache.org/jira/browse/HBASE-19389
>             Project: HBase
>          Issue Type: Improvement
>          Components: Performance
>    Affects Versions: 2.0.0
>         Environment: 2000+ Region Servers
> PCI-E ssd
>            Reporter: Chance Li
>            Assignee: Chance Li
>             Fix For: 2.0.0, 3.0.0
>
>         Attachments: CSLM-concurrent-write.png, metrics-1.png, ycsb-result.png
>
>
> In a large cluster, with a large number of clients, we found the RS's handlers are all
busy sometimes. And after investigation we found the root cause is about CSLM, such as compare
function heavy load. We reviewed the related WALs, and found that there were many columns
(more than 1000 columns) were writing at that time.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message