hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From James Seigel <ja...@tynt.com>
Subject Re: Packaging for Hadoop - what about the Hadoop libraries?
Date Fri, 25 Feb 2011 13:48:47 GMT
The ones that are present.

It is a little tricky for the other ones however, well not really once you “get it”

-libjars <list of supporting jars> on the commandline will ship the “supporting”
jars out with the job to the map reducers, however if you, for some reason need them in the
job submission they won’t be present,  you either need to have those in the command line
classpath or bundled.


On 2011-02-25, at 6:06 AM, Mark Kerzner wrote:

> Hi,
> when packaging additional libraries for an MR job, I can use a script or a
> Maven Hadoop plugin, but what about the Hadoop libraries themselves? Should
> I package them in, or should I rely on those jars that are already present
> in the Hadoop installation where the code will be running? What is the best
> practice?
> Thank you,
> Mark

View raw message