hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dan Adkins (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1382) MRAsyncDiscService should tolerate missing local.dir
Date Thu, 09 Sep 2010 00:41:34 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12907494#action_12907494
] 

Dan Adkins commented on MAPREDUCE-1382:
---------------------------------------

I have applied the latest patch to trunk and *still* I cannot start a task tracker if the
the directory does not exist:

10/09/09 00:36:29 WARN mapred.TaskTracker: Task Tracker local can not create directory: /mnt/data8/mr20
10/09/09 00:36:29 WARN util.MRAsyncDiskService: Cannot create toBeDeleted in /mnt/data8/mr20.
Ignored.
10/09/09 00:36:29 ERROR mapred.TaskTracker: Can not start task tracker because java.io.FileNotFoundException:
File /mnt/data8/mr20/toBeDeleted does not exist.
	at org.apache.hadoop.fs.RawLocalFileSystem.listStatus(RawLocalFileSystem.java:301)
	at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1071)
	at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1096)
	at org.apache.hadoop.fs.ChecksumFileSystem.listStatus(ChecksumFileSystem.java:494)
	at org.apache.hadoop.mapreduce.util.MRAsyncDiskService.<init>(MRAsyncDiskService.java:103)
	at org.apache.hadoop.mapreduce.util.MRAsyncDiskService.<init>(MRAsyncDiskService.java:127)
	at org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:616)
	at org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1323)
	at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3508)


> MRAsyncDiscService should tolerate missing local.dir
> ----------------------------------------------------
>
>                 Key: MAPREDUCE-1382
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1382
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: Scott Chen
>            Assignee: Zheng Shao
>         Attachments: MAPREDUCE-1382.1.patch, MAPREDUCE-1382.2.patch, MAPREDUCE-1382.3.patch,
MAPREDUCE-1382.branch-0.20.on.top.of.MAPREDUCE-1302.1.patch
>
>
> Currently when some of the local.dir do not exist, MRAsyncDiscService will fail. It should
only fail when all directories don't work.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message