incubator-crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Josh Wills <jwi...@cloudera.com>
Subject Re: Maven archetype for Crunch
Date Mon, 17 Sep 2012 18:05:19 GMT
On Mon, Sep 17, 2012 at 10:20 AM, Matthias Friedrich <matt@mafr.de> wrote:
> On Monday, 2012-09-17, Josh Wills wrote:
>> On Mon, Sep 17, 2012 at 10:04 AM, Matthias Friedrich <matt@mafr.de> wrote:
> [...]
>>> Another thing: In the archetype I had to add some dependencies that
>>> are missing from hadoop-core but are needed to get LocalJobRunner
>>> working. If we added those to Crunch, they would be added to the job
>>> JAR's lib directory unnecessarily. But they don't cause any trouble
>>> and it would make job setup easier for our users. What do you think?
>
>> How big are they, in terms of bytes?
>
> commons-io-2.1 is 163 KB and slf4j-api-1.4.3 is 15 KB. Without them,
> our lib directory is 3.9 MB for Hadoop 1.

Yeah, I'm fine with that.

>
> Regards,
>   Matthias



-- 
Director of Data Science
Cloudera
Twitter: @josh_wills

Mime
View raw message