hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mahajan, Neeraj" <nemaha...@ebay.com>
Subject Submitting a job in offline mode (non-interactive)
Date Mon, 16 Jul 2007 18:29:17 GMT
Hi,
 
I am trying to submit a job to hadoop in non-interactive (i.e. I just
want to submit the job and do not want to see the progress) mode. I
tried doing this; the job gets submitted but all the map tasks fail with
the following exception:
 
Error initializing task_0001_m_000011_0:
java.io.IOException:
/tmp/hadoop-nemahajan/mapred/system/submit_wdta1y/job.xml: No such file
or directory
	at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:113)
	at
org.apache.hadoop.fs.LocalFileSystem.copyToLocalFile(LocalFileSystem.jav
a:55)
	at
org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:780)
	at
org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:539)
	at
org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1087)
	at
org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:752)
	at
org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:1123)
	at
org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1853)

I have overridden JobClient#runJob() to achive this mode. I just do a
jc.submitJob() (similar to JobClient#runJob()), but I do not wait for
the status report. I just return. My guess is, the job is not getting
fully submitted, so the job xml is not getting created. Any thoughts on
what needs to be done.

Thanks,
Neeraj

Mime
View raw message