hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Patrick Kling (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-2155) RaidNode should optionally dispatch map reduce jobs to fix corrupt blocks (instead of fixing locally)
Date Thu, 25 Nov 2010 00:19:13 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Patrick Kling updated MAPREDUCE-2155:
-------------------------------------

    Attachment: MAPREDUCE-2155.patch

This change adds a new implementation of the raid block fixer that uses map reduce jobs to
fix missing/corrupt blocks, which allows us to fix a large number of blocks quickly. The user
can specify via a configuration variable whether the old (local) or the new implementation
should be used.

> RaidNode should optionally dispatch map reduce jobs to fix corrupt blocks (instead of
fixing locally)
> -----------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2155
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2155
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: Patrick Kling
>         Attachments: MAPREDUCE-2155.patch
>
>
> Recomputing blocks based on parity information is expensive. Rather than doing this locally
at the RaidNode, we should run map reduce jobs. This will allow us to quickly fix a large
number of corrupt or missing blocks.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message