hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raghava Mutharaju <m.vijayaragh...@gmail.com>
Subject Re: Using external library in MapReduce jobs
Date Thu, 22 Apr 2010 23:04:48 GMT
Hello Farhan,

        I use an external library and I run the MR job from command line. So
I specify it in -libjars as follows

hadoop jar (my jar) (my class) -libjars (external jar) (args for my class)

Raghava.

On Thu, Apr 22, 2010 at 6:21 PM, Farhan Husain <farhan.husain@csebuet.org>wrote:

> Hello guys,
>
> Can you please tell me how I can use external libraries which my jobs link
> to in a MapReduce job? I added the following lines in mapred-site.xml in
> all
> my nodes and put the external library jars in the specified directory but I
> am getting ClassNotFoundException:
>
> <property>
>  <name>mapred.child.java.opts</name>
>  <value>-Xmx512m -Djava.library.path=/hadoop/Hadoop/userlibs</value>
> </property>
>
> Am I doing anything wrong? Is there any other way to solve my problem?
>
> Thanks,
> Farhan
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message