hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Gray (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-1476) scaling compaction with milti threads
Date Wed, 25 Aug 2010 01:10:18 GMT

    [ https://issues.apache.org/jira/browse/HBASE-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12902250#action_12902250
] 

Jonathan Gray commented on HBASE-1476:
--------------------------------------

HBASE-2405 deals with open/close of regions not compactions?  This is more of a dupe of HBASE-2832
which deals with multi-threading of flushing.  The solutions will be very much the same (using
the new EventHandlers) for flushing and compacting.  And again, I'm hoping to do this for
0.90.

> scaling compaction with milti threads
> -------------------------------------
>
>                 Key: HBASE-1476
>                 URL: https://issues.apache.org/jira/browse/HBASE-1476
>             Project: HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: Billy Pearson
>            Assignee: Jonathan Gray
>             Fix For: 0.90.0
>
>
> Was thinking we should build in support to be able to handle more then one thread for
compactions this will allow us to keep up with compactions when we get to the point where
we store Tb's of data per node and may regions
> Maybe a configurable setting to set how many threads a region server can use for compactions.
> With compression turned on my compactions are limited by cpu speed with multi cores then
it would be nice to be able to scale compactions to 2 or more cores.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message