hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: ClassNotFoundException with contrib/join example
Date Sat, 27 Mar 2010 03:23:20 GMT
Then use the syntax given by
http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/util/GenericOptionsParser.html
:

$ bin/hadoop jar -libjars ./samplejoin.jar
/opt/hadoop-0.20.2/contrib/datajoin/hadoop-0.20.2-datajoin.jar
org.apache.hadoop.contrib.utils.join.DataJoinJob datajoin/input ...

On Fri, Mar 26, 2010 at 5:10 PM, M B <machaca74@gmail.com> wrote:

> Sorry, but where exactly do I include the libjars option?  I tried to put
> it
> where you stated (after the DataJoinJob class), but it just comes back with
> usage information (as if the option is not valid):
> $ <p@hadoop01:~/hadoop_tests$> hadoop jar
> /opt/hadoop-0.20.2/contrib/datajoin/hadoop-0.20.2-datajoin.jar
> org.apache.hadoop.contrib.utils.join.DataJoinJob -libjars ./samplejoin.jar
> datajoin/input datajoin/output Text 1
> org.apache.hadoop.contrib.utils.join.SampleDataJoinMapper
> org.apache.hadoop.contrib.utils.join.SampleDataJoinReducer
> org.apache.hadoop.contrib.utils.join.SampleTaggedMapOutput Text
> *usage: DataJoinJob inputdirs outputdir map_input_file_format numofParts
> mapper_class reducer_class map_output_value_class output_value_class
> [maxNumOfValuesPerGroup [descriptionOfJob]]]*
>
> It seems like it's not taking the option for some reason, like it's failing
> an argument check in DataJoinJob - does that not use the standard args or
> something?
>
>
> On Fri, Mar 26, 2010 at 4:38 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>
> > DataJoinJob is contained in hadoop-0.20.2-datajoin.jar which is in your
> > HADOOP_CLASSPATH
> >
> > I think you should specify samplejoin.jar using -libjars instead of
> putting
> > it directly after jar command:
> > hadoop jar hadoop-0.20.2-datajoin.jar
> > org.apache.hadoop.contrib.utils.join.DataJoinJob -libjars
> ./samplejoin.jar
> > ... (same as your example)
> >
> > Cheers
> >
> > On Fri, Mar 26, 2010 at 3:24 PM, M B <machaca74@gmail.com> wrote:
> >
> > > I may be having a setup issue with classpaths, would appreciate some
> > help.
> > >
> > > I created a jar with all the Sample* classes in contrib/DataJoin.  Here
> > is
> > > the listing of my samplejoin.jar file:
> > > " zip.vim version v22
> > > " Browsing zipfile /home/hadoop/hadoop_tests/samplejoin.jar
> > > " Select a file with cursor and press ENTER
> > > META-INF/
> > > META-INF/MANIFEST.MF
> > > org/
> > > org/apache/
> > > org/apache/hadoop/
> > > org/apache/hadoop/contrib/
> > > org/apache/hadoop/contrib/utils/
> > > org/apache/hadoop/contrib/utils/join/
> > > org/apache/hadoop/contrib/utils/join/SampleDataJoinReducer.class
> > > org/apache/hadoop/contrib/utils/join/SampleTaggedMapOutput.class
> > > org/apache/hadoop/contrib/utils/join/SampleDataJoinMapper.class
> > >
> > > When I go to run this, things start to run, but every Map try errors
> out
> > > with:
> > > "java.lang.RuntimeException: java.lang.ClassNotFoundException:
> > > org.apache.hadoop.contrib.utils.join.SampleTaggedMapOutput"
> > >
> > > Here is the command:
> > > hadoop jar ./samplejoin.jar
> > > org.apache.hadoop.contrib.utils.join.DataJoinJob
> > > datajoin/input datajoin/output Text 1
> > > org.apache.hadoop.contrib.utils.join.SampleDataJoinMapper
> > > org.apache.hadoop.contrib.utils.join.SampleDataJoinReducer
> > > org.apache.hadoop.contrib.utils.join.SampleTaggedMapOutput Text
> > >
> > > This is a new install of 0.20.2.
> > >
> > > HADOOP_CLASSPATH is set
> > > to: /opt/hadoop-0.20.2/contrib/datajoin/hadoop-0.20.2-datajoin.jar
> > > Any help would be appreciated.
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message