hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-2155) RaidNode should optionally dispatch map reduce jobs to fix corrupt blocks (instead of fixing locally)
Date Sat, 04 Dec 2010 16:42:20 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12966838#action_12966838
] 

Hudson commented on MAPREDUCE-2155:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #557 (See [https://hudson.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/557/])
    MAPREDUCE-2155. RaidNode should optionally use the mapreduce jobs to 
fix missing blocks.  (Patrick Kling via dhruba)


> RaidNode should optionally dispatch map reduce jobs to fix corrupt blocks (instead of
fixing locally)
> -----------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2155
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2155
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/raid
>    Affects Versions: 0.23.0
>            Reporter: Patrick Kling
>            Assignee: Patrick Kling
>             Fix For: 0.23.0
>
>         Attachments: MAPREDUCE-2155.2.patch, MAPREDUCE-2155.patch
>
>
> Recomputing blocks based on parity information is expensive. Rather than doing this locally
at the RaidNode, we should run map reduce jobs. This will allow us to quickly fix a large
number of corrupt or missing blocks.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message