Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 257EBE1DE for ; Sun, 6 Jan 2013 09:22:15 +0000 (UTC) Received: (qmail 82251 invoked by uid 500); 6 Jan 2013 09:22:15 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 82211 invoked by uid 500); 6 Jan 2013 09:22:14 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 82199 invoked by uid 99); 6 Jan 2013 09:22:14 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 06 Jan 2013 09:22:14 +0000 Date: Sun, 6 Jan 2013 09:22:14 +0000 (UTC) From: "Ru Ying (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (MAPREDUCE-4917) multiple BlockFixer should be supported in order to improve scalability and reduce too much work on single BlockFixer MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-4917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ru Ying updated MAPREDUCE-4917: ------------------------------- Attachment: (was: MAPREDUCE-4917.2patch) > multiple BlockFixer should be supported in order to improve scalability and reduce too much work on single BlockFixer > --------------------------------------------------------------------------------------------------------------------- > > Key: MAPREDUCE-4917 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4917 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: contrib/raid > Affects Versions: 0.22.0 > Reporter: Jun Jin > Assignee: Jun Jin > Labels: patch > Fix For: 0.22.0 > > Attachments: MAPREDUCE-4917.1.patch > > Original Estimate: 672h > Remaining Estimate: 672h > > current implementation can only run single BlockFixer since the fsck (in RaidDFSUtil.getCorruptFiles) only check the whole DFS file system. multiple BlockFixer will do the same thing and try to fix same file if multiple BlockFixer launched. > the change/fix will be mainly in BlockFixer.java and RaidDFSUtil.getCorruptFile(), to enable fsck to check the different paths defined in separated Raid.xml for single RaidNode/BlockFixer -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira