hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From aa...@buffalo.edu
Subject Re: Re: Doubt in Hadoop
Date Fri, 27 Nov 2009 07:56:10 GMT
Hi,
   I am running the job from command line. The job runs fine in the local mode
but something happens when I try to run the job in the distributed mode.


Abhishek Agrawal

SUNY- Buffalo
(716-435-7122)

On Fri 11/27/09  2:31 AM , Jeff Zhang zjffdu@gmail.com sent:
> Do you run the map reduce job in command line or IDE?  in map reduce
> mode, you should put the jar containing the map and reduce class in
> your classpath
> Jeff Zhang
> On Fri, Nov 27, 2009 at 2:19 PM,   wrote:
> Hello Everybody,
>                I have a doubt in Haddop and was wondering if
> anybody has faced a
> similar problem. I have a package called test. Inside that I have
> class called
> A.java, Map.java, Reduce.java. In A.java I have the main method
> where I am trying
> to initialize the jobConf object. I have written
> jobConf.setMapperClass(Map.class) and similarly for the reduce class
> as well. The
> code works correctly when I run the code locally via
> jobConf.set("mapred.job.tracker","local") but I get an exception
> when I try to
> run this code on my cluster. The stack trace of the exception is as
> under. I
> cannot understand the problem. Any help would be appreciated.
> java.lang.RuntimeException: java.lang.RuntimeException:
> java.lang.ClassNotFoundException: test.Map
>        at
> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:752)
>        at
> org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:690)
>        at
> org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>        at
> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:58)
>        at
> 
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:83)
>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:338)
>        at org.apache.hadoop.mapred.Child.main(Child.java:158)
> Caused by: java.lang.RuntimeException:
> java.lang.ClassNotFoundException:
> Markowitz.covarMatrixMap
>        at
> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:720)
>        at
> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:744)
>        ... 6 more
> Caused by: java.lang.ClassNotFoundException: test.Map
>        at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>        at java.security.AccessController.doPrivileged(Native
> Method)
>        at
> java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>        at
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:276)
>        at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
>        at
> java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
>        at java.lang.Class.forName0(Native Method)
>        at java.lang.Class.forName(Class.java:247)
>        at
> 
> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:673)
>        at
> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:718)
>        ... 7 more
> Thank You
> Abhishek Agrawal
> SUNY- Buffalo
> (716-435-7122)
> 
> 


Mime
View raw message