Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 93BACEA36 for ; Sat, 5 Jan 2013 08:02:13 +0000 (UTC) Received: (qmail 86332 invoked by uid 500); 5 Jan 2013 08:02:13 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 86301 invoked by uid 500); 5 Jan 2013 08:02:13 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 86265 invoked by uid 99); 5 Jan 2013 08:02:12 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 05 Jan 2013 08:02:12 +0000 Date: Sat, 5 Jan 2013 08:02:12 +0000 (UTC) From: "Jun Jin (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (MAPREDUCE-4917) multiple BlockFixer should be supported in order to improve scalability and reduce too much work on single BlockFixer MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-4917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Jin updated MAPREDUCE-4917: ------------------------------- Attachment: (was: HDFS-4360.patch) > multiple BlockFixer should be supported in order to improve scalability and reduce too much work on single BlockFixer > --------------------------------------------------------------------------------------------------------------------- > > Key: MAPREDUCE-4917 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4917 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: contrib/raid > Affects Versions: 0.22.0 > Reporter: Jun Jin > Assignee: Jun Jin > Labels: patch > Fix For: 0.22.0 > > Original Estimate: 672h > Remaining Estimate: 672h > > current implementation can only run single BlockFixer since the fsck (in RaidDFSUtil.getCorruptFiles) only check the whole DFS file system. multiple BlockFixer will do the same thing and try to fix same file if multiple BlockFixer launched. > the change/fix will be mainly in BlockFixer.java and RaidDFSUtil.getCorruptFile(), to enable fsck to check the different paths defined in separated Raid.xml for single RaidNode/BlockFixer -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira