Return-Path: Delivered-To: apmail-hadoop-hbase-dev-archive@minotaur.apache.org Received: (qmail 46304 invoked from network); 26 Jan 2010 17:05:07 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 26 Jan 2010 17:05:07 -0000 Received: (qmail 92600 invoked by uid 500); 26 Jan 2010 17:05:06 -0000 Delivered-To: apmail-hadoop-hbase-dev-archive@hadoop.apache.org Received: (qmail 92554 invoked by uid 500); 26 Jan 2010 17:05:06 -0000 Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-dev@hadoop.apache.org Delivered-To: mailing list hbase-dev@hadoop.apache.org Received: (qmail 92376 invoked by uid 99); 26 Jan 2010 17:05:06 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 26 Jan 2010 17:05:06 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 26 Jan 2010 17:05:05 +0000 Received: from brutus.apache.org (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id DD79D234C4B8 for ; Tue, 26 Jan 2010 09:04:44 -0800 (PST) Message-ID: <439574732.41381264525484906.JavaMail.jira@brutus.apache.org> Date: Tue, 26 Jan 2010 17:04:44 +0000 (UTC) From: "stack (JIRA)" To: hbase-dev@hadoop.apache.org Subject: [jira] Commented: (HBASE-2066) Perf: parallelize puts In-Reply-To: <9068352.1261458618079.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12805098#action_12805098 ] stack commented on HBASE-2066: ------------------------------ Patch looks good. Make sure all licenses are 2010 on commit and add some class comment to new classes saying what they do on commit. You don't up the RPC version? Otherwise it looks great RR. > Perf: parallelize puts > ---------------------- > > Key: HBASE-2066 > URL: https://issues.apache.org/jira/browse/HBASE-2066 > Project: Hadoop HBase > Issue Type: Bug > Affects Versions: 0.20.2 > Reporter: ryan rawson > Assignee: ryan rawson > Fix For: 0.21.0 > > Attachments: HBASE-2066-branch.patch, HBASE-2066-v2.patch > > > Right now with large region count tables, the write buffer is not efficient. This is because we issue potentially N RPCs, where N is the # of regions in the table. When N gets large (lets say 1200+) things become sloowwwww. > Instead if we batch things up using a different RPC and use thread pools, we could see higher performance! > This requires a RPC change... -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.