Return-Path: Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: (qmail 1028 invoked from network); 10 Dec 2010 05:25:22 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 10 Dec 2010 05:25:22 -0000 Received: (qmail 38219 invoked by uid 500); 10 Dec 2010 05:25:22 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 38195 invoked by uid 500); 10 Dec 2010 05:25:22 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 38187 invoked by uid 99); 10 Dec 2010 05:25:22 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Dec 2010 05:25:22 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Dec 2010 05:25:21 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id oBA5P1LU001247 for ; Fri, 10 Dec 2010 05:25:01 GMT Message-ID: <23515212.52561291958701070.JavaMail.jira@thor> Date: Fri, 10 Dec 2010 00:25:01 -0500 (EST) From: "stack (JIRA)" To: issues@hbase.apache.org Subject: [jira] Commented: (HBASE-3329) HLog splitting after RS/cluster death should directly create HFiles In-Reply-To: <12966144.51281291947060930.JavaMail.jira@thor> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-3329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12970073#action_12970073 ] stack commented on HBASE-3329: ------------------------------ This is fine if one family per region but if ten families per region and 1k regions on the server, could be a bunch of juggling of files by master process > HLog splitting after RS/cluster death should directly create HFiles > ------------------------------------------------------------------- > > Key: HBASE-3329 > URL: https://issues.apache.org/jira/browse/HBASE-3329 > Project: HBase > Issue Type: Bug > Components: regionserver > Reporter: Karthik Ranganathan > > After a RS dies or the cluster goes down and we are recovering, we first split HLogs into the logs for the regions. Then the region servers that host the regions replay the logs and open the regions. > This can be made more efficient by directly creating HFiles from the HLogs (instead of producing a split HLogs file). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.