hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shrijeet Paliwal <shrij...@rocketfuel.com>
Subject Re: Adding files to map/reduce classpath
Date Tue, 26 Jul 2011 19:35:48 GMT
**
See if this (very old) reply from Mikhail helps.
http://search-hadoop.com/m/QFVD1kEmQT
Here is the patch he is referring to.
http://m1.archiveorange.com/m/att/RNVYm/ArchiveOrange_8dEcdJI4bXFkKHBnsll8YzTc8u8a.patch

**replying in hurry

On Tue, Jul 26, 2011 at 12:28 PM, John Armstrong
<john.armstrong@ccri.com> wrote:
> I'm back to trying to add libraries to the classpath instead of handing
> around a fat JAR.  This time I've served up my directory full of JARs on
> NFS, which each node in my cluster has mounted at /mnt/hadoop-libs.  Now my
> question is how to add that (local) directory to the classpath of the
> mapper and reducer tasks.  I've tried adding "-classpath
> /mnt/hadoop-libs/*" to mapred.map.child.java.opts, but it doesn't seem to
> work; the actual classpath I can see being called is just the local
> /usr/lib/hadoop/lib stuff as usual.
>

Mime
View raw message