hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Runping Qi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-810) The non-existence of the job.xml file causes a LOT of tasks of the job fail
Date Tue, 12 Dec 2006 21:36:23 GMT
    [ http://issues.apache.org/jira/browse/HADOOP-810?page=comments#action_12457887 ] 
            
Runping Qi commented on HADOOP-810:
-----------------------------------


If the patch for HADOOP-639 fixed the problem of incorrectly removing job.xml file, then it
fixes the root problem of the current problem (HADOOP-810), and I am fine with that. 



> The non-existence of the job.xml file causes a LOT of tasks of the job fail
> ---------------------------------------------------------------------------
>
>                 Key: HADOOP-810
>                 URL: http://issues.apache.org/jira/browse/HADOOP-810
>             Project: Hadoop
>          Issue Type: Bug
>            Reporter: Runping Qi
>         Assigned To: Arun C Murthy
>
> For some reason, the job.xml file disappears from one of the nodes. That causes the following
exception:
> java.lang.RuntimeException: java.lang.RuntimeException:  taskTracker/jobcache/job_0039/job.xml
not found
> 	at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:551)
> 	at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:472)
> 	at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:453)
> 	at org.apache.hadoop.conf.Configuration.get(Configuration.java:201)
> 	at org.apache.hadoop.conf.Configuration.getBoolean(Configuration.java:286)
> 	at org.apache.hadoop.mapred.JobConf.getKeepFailedTaskFiles(JobConf.java:212)
> 	at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.setJobConf(TaskTracker.java:874)
> 	at org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:313)
> 	at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:307)
> 	at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:691)
> 	at org.apache.hadoop.mapred.TaskTracker.checkForNewTasks(TaskTracker.java:533)
> 	at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:448)
> 	at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:720)
> 	at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1374)
> That is fine by itself.
> The problem is the task tracker keeps accepting tasks of the same job, and keeps failing
them!
> The correct behavior is that it either tries to get the job.xml from the job tracker,
or refuses accepting any new tasks 
> of the same job.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message