hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jun Jin (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-4917) multiple BlockFixer should be supported in order to improve scalability and reduce too much work on single BlockFixer
Date Sat, 05 Jan 2013 08:02:12 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-4917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jun Jin updated MAPREDUCE-4917:
-------------------------------

    Attachment:     (was: HDFS-4360.patch)
    
> multiple BlockFixer should be supported in order to improve scalability and reduce too
much work on single BlockFixer
> ---------------------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-4917
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4917
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/raid
>    Affects Versions: 0.22.0
>            Reporter: Jun Jin
>            Assignee: Jun Jin
>              Labels: patch
>             Fix For: 0.22.0
>
>   Original Estimate: 672h
>  Remaining Estimate: 672h
>
> current implementation can only run single BlockFixer since the fsck (in RaidDFSUtil.getCorruptFiles)
only check the whole DFS file system. multiple BlockFixer will do the same thing and try to
fix same file if multiple BlockFixer launched.
> the change/fix will be mainly in BlockFixer.java and RaidDFSUtil.getCorruptFile(), to
enable fsck to check the different paths defined in separated Raid.xml for single RaidNode/BlockFixer

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message