hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jun Jin (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-4917) multiple BlockFixer should be supported in order to improve scalability and reduce too much work on single BlockFixer
Date Sat, 05 Jan 2013 07:50:13 GMT
Jun Jin created MAPREDUCE-4917:
----------------------------------

             Summary: multiple BlockFixer should be supported in order to improve scalability
and reduce too much work on single BlockFixer
                 Key: MAPREDUCE-4917
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4917
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: contrib/raid
    Affects Versions: 0.22.0
            Reporter: Jun Jin
            Assignee: Jun Jin
             Fix For: 0.22.0


current implementation can only run single BlockFixer since the fsck (in RaidDFSUtil.getCorruptFiles)
only check the whole DFS file system. multiple BlockFixer will do the same thing and try to
fix same file if multiple BlockFixer launched.
the change/fix will be mainly in BlockFixer.java and RaidDFSUtil.getCorruptFile(), to enable
fsck to check the different paths defined in separated Raid.xml for single RaidNode/BlockFixer

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message