hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Boudnik (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1933) Create automated testcase for tasktracker dealing with corrupted disk.
Date Wed, 14 Jul 2010 18:17:52 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12888468#action_12888468

Konstantin Boudnik commented on MAPREDUCE-1933:

bq. prop.put("mapred.local.dir", "/grid/0/dev/tmp/mapred/mapred-local,/grid/1/dev/tmp/mapred/mapred-local,/grid/2/dev/tmp/mapred/mapred-local,/grid/3/dev/tmp/mapred/mapred-local");

Absolutely, besides this particular parameter should be set by a normal MR config already.

Also, please don't use string literals for configuration parameters. There was a significant
effort in 0.21 to have all configuration keys refactored to named constants. Use them instead.

> Create automated testcase for tasktracker dealing with corrupted disk.
> ----------------------------------------------------------------------
>                 Key: MAPREDUCE-1933
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1933
>             Project: Hadoop Map/Reduce
>          Issue Type: Test
>          Components: test
>            Reporter: Iyappan Srinivasan
>            Assignee: Iyappan Srinivasan
>         Attachments: TestCorruptedDiskJob.java
> After the TaskTracker has already run some tasks successfully, "corrupt" a disk by making
the corresponding mapred.local.dir unreadable/unwritable. 
> Make sure that jobs continue to succeed even though some tasks scheduled there fail.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message