Return-Path: Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: (qmail 79924 invoked from network); 29 Mar 2011 01:42:46 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 29 Mar 2011 01:42:46 -0000 Received: (qmail 61810 invoked by uid 500); 29 Mar 2011 01:42:45 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 61778 invoked by uid 500); 29 Mar 2011 01:42:45 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 61767 invoked by uid 99); 29 Mar 2011 01:42:45 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Mar 2011 01:42:45 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Mar 2011 01:42:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id E9D8D84C1A for ; Tue, 29 Mar 2011 01:42:05 +0000 (UTC) Date: Tue, 29 Mar 2011 01:42:05 +0000 (UTC) From: "Nicolas Spiegelberg (JIRA)" To: issues@hbase.apache.org Message-ID: <1798639068.18018.1301362925954.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HBASE-1476) scaling compaction with multiple threads MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HBASE-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13012312#comment-13012312 ] Nicolas Spiegelberg commented on HBASE-1476: -------------------------------------------- FYI: responded to stack's commentary on RB > scaling compaction with multiple threads > ---------------------------------------- > > Key: HBASE-1476 > URL: https://issues.apache.org/jira/browse/HBASE-1476 > Project: HBase > Issue Type: Improvement > Components: regionserver > Reporter: Billy Pearson > Assignee: Nicolas Spiegelberg > Labels: moved_from_0_20_5 > Fix For: 0.92.0 > > > Was thinking we should build in support to be able to handle more then one thread for compactions this will allow us to keep up with compactions when we get to the point where we store Tb's of data per node and may regions > Maybe a configurable setting to set how many threads a region server can use for compactions. > With compression turned on my compactions are limited by cpu speed with multi cores then it would be nice to be able to scale compactions to 2 or more cores. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira