hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From <praveen.pe...@nokia.com>
Subject Re: Packaging for Hadoop - what about the Hadoop libraries?
Date Fri, 25 Feb 2011 13:46:23 GMT
Just package the libraries that you MR jobs are dependent on. No need to package hadoop libraries.
But make sure you hadoop client version matches with server version.

Praveen

On Feb 25, 2011, at 8:07 AM, "ext Mark Kerzner" <markkerzner@gmail.com> wrote:

> Hi,
> 
> when packaging additional libraries for an MR job, I can use a script or a
> Maven Hadoop plugin, but what about the Hadoop libraries themselves? Should
> I package them in, or should I rely on those jars that are already present
> in the Hadoop installation where the code will be running? What is the best
> practice?
> 
> Thank you,
> Mark

Mime
View raw message