hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-1476) scaling compaction with multiple threads
Date Sat, 26 Mar 2011 06:22:05 GMT

    [ https://issues.apache.org/jira/browse/HBASE-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13011578#comment-13011578

stack commented on HBASE-1476:

I did a first pass review N over on RB.  Good stuff.

> scaling compaction with multiple threads
> ----------------------------------------
>                 Key: HBASE-1476
>                 URL: https://issues.apache.org/jira/browse/HBASE-1476
>             Project: HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: Billy Pearson
>            Assignee: Nicolas Spiegelberg
>              Labels: moved_from_0_20_5
>             Fix For: 0.92.0
> Was thinking we should build in support to be able to handle more then one thread for
compactions this will allow us to keep up with compactions when we get to the point where
we store Tb's of data per node and may regions
> Maybe a configurable setting to set how many threads a region server can use for compactions.
> With compression turned on my compactions are limited by cpu speed with multi cores then
it would be nice to be able to scale compactions to 2 or more cores.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message