Return-Path: Delivered-To: apmail-hadoop-hbase-dev-archive@locus.apache.org Received: (qmail 55158 invoked from network); 24 Dec 2008 18:39:07 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 24 Dec 2008 18:39:07 -0000 Received: (qmail 97616 invoked by uid 500); 24 Dec 2008 18:39:07 -0000 Delivered-To: apmail-hadoop-hbase-dev-archive@hadoop.apache.org Received: (qmail 97595 invoked by uid 500); 24 Dec 2008 18:39:07 -0000 Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-dev@hadoop.apache.org Delivered-To: mailing list hbase-dev@hadoop.apache.org Received: (qmail 97584 invoked by uid 99); 24 Dec 2008 18:39:07 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 24 Dec 2008 10:39:07 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 24 Dec 2008 18:39:05 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 48784234C468 for ; Wed, 24 Dec 2008 10:38:44 -0800 (PST) Message-ID: <1711073678.1230143924295.JavaMail.jira@brutus> Date: Wed, 24 Dec 2008 10:38:44 -0800 (PST) From: "stack (JIRA)" To: hbase-dev@hadoop.apache.org Subject: [jira] Updated: (HBASE-1062) Compactions at (re)start on a large table can overwhelm DFS In-Reply-To: <91731297.1229258564318.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HBASE-1062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-1062: ------------------------- Fix Version/s: (was: 0.20.0) 0.19.0 Bringing in to 0.19.0 so gets reviewed and considered for commit in 0.19.0. > Compactions at (re)start on a large table can overwhelm DFS > ----------------------------------------------------------- > > Key: HBASE-1062 > URL: https://issues.apache.org/jira/browse/HBASE-1062 > Project: Hadoop HBase > Issue Type: Bug > Components: regionserver > Reporter: Andrew Purtell > Assignee: Andrew Purtell > Priority: Critical > Fix For: 0.19.0 > > Attachments: 1062-1.patch, 1062-2.patch > > > Given a large table, > 1000 regions for example, if a cluster restart is necessary, the compactions undertaken by the regionservers when the master makes initial region assignments can overwhelm DFS, leading to file errors and data loss. This condition is exacerbated if write load was heavy before restart and so many regions want to split as soon as they are opened. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.