hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nicolas Spiegelberg (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-1476) scaling compaction with multiple threads
Date Fri, 25 Mar 2011 01:49:05 GMT

     [ https://issues.apache.org/jira/browse/HBASE-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Nicolas Spiegelberg updated HBASE-1476:
---------------------------------------

    Status: Patch Available  (was: Open)

This is a decently-complicated fix.  Up on Review Board at: 

https://review.cloudera.org/r/1664/

> scaling compaction with multiple threads
> ----------------------------------------
>
>                 Key: HBASE-1476
>                 URL: https://issues.apache.org/jira/browse/HBASE-1476
>             Project: HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: Billy Pearson
>            Assignee: Nicolas Spiegelberg
>              Labels: moved_from_0_20_5
>             Fix For: 0.92.0
>
>
> Was thinking we should build in support to be able to handle more then one thread for
compactions this will allow us to keep up with compactions when we get to the point where
we store Tb's of data per node and may regions
> Maybe a configurable setting to set how many threads a region server can use for compactions.
> With compression turned on my compactions are limited by cpu speed with multi cores then
it would be nice to be able to scale compactions to 2 or more cores.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message