hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nicolas Spiegelberg (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-1476) scaling compaction with multiple threads
Date Fri, 01 Apr 2011 16:57:05 GMT

    [ https://issues.apache.org/jira/browse/HBASE-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13014740#comment-13014740
] 

Nicolas Spiegelberg commented on HBASE-1476:
--------------------------------------------

I did some minor refactoring in an internal peer review that's ongoing.  I think it's all
wrapped up, but waiting to confirm.  I will re-post the patch and commit once done.

> scaling compaction with multiple threads
> ----------------------------------------
>
>                 Key: HBASE-1476
>                 URL: https://issues.apache.org/jira/browse/HBASE-1476
>             Project: HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: Billy Pearson
>            Assignee: Nicolas Spiegelberg
>              Labels: moved_from_0_20_5
>             Fix For: 0.92.0
>
>
> Was thinking we should build in support to be able to handle more then one thread for
compactions this will allow us to keep up with compactions when we get to the point where
we store Tb's of data per node and may regions
> Maybe a configurable setting to set how many threads a region server can use for compactions.
> With compression turned on my compactions are limited by cpu speed with multi cores then
it would be nice to be able to scale compactions to 2 or more cores.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message