hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Foss User <foss...@gmail.com>
Subject Setting /etc/hosts entry for namenode causes job submission failure
Date Sun, 05 Apr 2009 12:58:12 GMT
I have a Linux machine where I do not run namenode or tasktracker but
I have hadoop installed. I use this machine to submit jobs to the
cluster. I see that the moment I put /etc/hosts entry for my-namenode,
I get the following error:

fossist@cave:~/mcr-wordcount$ hadoop jar dist/mcr-wordcount-0.1.jar
com.fossist.examples.WordCountJob /fossist/inputs /fossist/output25
09/04/05 17:30:11 WARN mapred.JobClient: Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the
same.
java.lang.IllegalArgumentException: Wrong FS:
hdfs://192.168.1.2:9000/tmp/hadoop-hadoop/mapred/system/job_200904042051_0032,
expected: hdfs://my-namenode:9000
	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:322)
	at org.apache.hadoop.hdfs.DistributedFileSystem.checkPath(DistributedFileSystem.java:92)
	at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:148)
	at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:222)
	at org.apache.hadoop.mapred.JobClient.configureCommandLineOptions(JobClient.java:605)
	at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:788)
	at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1142)
	at in.fossist.examples.WordCountJob.main(Unknown Source)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:165)
	at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
	at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68)

Since, I can not put the /etc/hosts mapping, I am unable to use the
Jetty pages of namenode and jobtracker as they often point to URLs
with domain names instead of IP addresses. Please help me in resolving
this issue.

Mime
View raw message