From hdfs-dev-return-1683-apmail-hadoop-hdfs-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Oct 25 20:52:45 2010 Return-Path: Delivered-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Received: (qmail 31354 invoked from network); 25 Oct 2010 20:52:44 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 25 Oct 2010 20:52:44 -0000 Received: (qmail 87830 invoked by uid 500); 25 Oct 2010 20:52:44 -0000 Delivered-To: apmail-hadoop-hdfs-dev-archive@hadoop.apache.org Received: (qmail 87760 invoked by uid 500); 25 Oct 2010 20:52:44 -0000 Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-dev@hadoop.apache.org Delivered-To: mailing list hdfs-dev@hadoop.apache.org Received: (qmail 87752 invoked by uid 99); 25 Oct 2010 20:52:44 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 25 Oct 2010 20:52:44 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 25 Oct 2010 20:52:42 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id o9PKqK5c027009 for ; Mon, 25 Oct 2010 20:52:20 GMT Message-ID: <26503455.66151288039940898.JavaMail.jira@thor> Date: Mon, 25 Oct 2010 16:52:20 -0400 (EDT) From: "Patrick Kling (JIRA)" To: hdfs-dev@hadoop.apache.org Subject: [jira] Created: (HDFS-1476) listCorruptFileBlocks should be functional while the name node is still in safe mode MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org listCorruptFileBlocks should be functional while the name node is still in safe mode ------------------------------------------------------------------------------------ Key: HDFS-1476 URL: https://issues.apache.org/jira/browse/HDFS-1476 Project: Hadoop HDFS Issue Type: Improvement Reporter: Patrick Kling This would allow us to detect whether missing blocks can be fixed using Raid and if that is the case exit safe mode earlier. One way to make listCorruptFileBlocks available before the name node has exited from safe mode would be to perform a scan of the blocks map on each call to listCorruptFileBlocks to determine if there are any blocks with no replicas. This scan could be parallelized by dividing the space of block IDs into multiple intervals than can be scanned independently. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.