hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pramy Bhats <pramybh...@googlemail.com>
Subject Debuging hadoop core
Date Tue, 13 Jul 2010 22:07:51 GMT
Hi,

I am trying to debug the new built hadoop-core-dev.jar in Eclipse. To
simplify the debug process, firstly I setup the Hadoop in single-node mode
on my localhost.


a)  configure debug in eclipse,

    under tab main:
      project : hadoop-all
      main-class: org.apache.hadoop.util.RunJar

   under tab arguments:

   program arguments: <absolute path for wordcount jar file>/wordcount.jar
 org.wordcount.WordCount   <input-text-file-already-in-hdfs> (text)
 <desired-output-file> (output)
   VM arguments: -Xmx256M


  under tab classpath:

  user entries :  add external jar  ( hadoop-0.20.3-core-dev.jar ) ==> so
that I can debug my new built hadoop core jar.


under tab source:

 I add the source file folder for the wordcount example ( in order lookup
for the debug process).


I apply these configuration and start debug process.


b)  the debugging works fine, and i can perform all operations for debug.
However, i get following problem

2010-07-14 00:02:15,816 WARN  conf.Configuration
(Configuration.java:<clinit>(176)) - DEPRECATED: hadoop-site.xml found in
the classpath. Usage of hadoop-site.xml is deprecated. Instead use
core-site.xml, mapred-site.xml and hdfs-site.xml to override properties of
core-default.xml, mapred-default.xml and hdfs-default.xml respectively
2010-07-14 00:02:16,535 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) -
Initializing JVM Metrics with processName=JobTracker, sessionId=
Exception in thread "main"
org.apache.hadoop.mapreduce.lib.input.InvalidInputException: *Input path
does not exist: file:/home/hadoop/code/hadoop-0.20.2/text*
at
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:224)
at
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:241)
at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
at org.selfadjust.wordcount.WordCount.run(WordCount.java:32)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.selfadjust.wordcount.WordCount.main(WordCount.java:43)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)


However, the file named "text" is the file already stored in the hdfs.


Could you please help me with debugging process here, any pointers to the
debugging environment would be very helpful.


thanks,

--PB

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message