hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Koji Noguchi (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-1991) Task startup fail when localizeTask directory is full
Date Wed, 03 Oct 2007 19:54:50 GMT
Task startup fail when localizeTask directory is full

                 Key: HADOOP-1991
                 URL: https://issues.apache.org/jira/browse/HADOOP-1991
             Project: Hadoop
          Issue Type: Bug
          Components: mapred
            Reporter: Koji Noguchi
            Priority: Minor
             Fix For: 0.16.0

We had a job filling up one particular drive (different bug) that resulted in all the subsequent
tasks on that node to fail with 
java.io.IOException: Mkdirs failed to create /vol2/mapred-tt/mapred-local/taskTracker/jobcache/job_200710030011_0001/task_200710030011_0001_m_007363_0
	at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:1284)
	at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:1344)
	at org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:647)
	at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:640)
	at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1167)
	at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:832)
	at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:1203)
	at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1888)

It'll be nice if localization also uses localdirallocator to utilize multiple disks.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message