hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon" <edwardy...@apache.org>
Subject Re: Shade-plugin in examples and yarn modules' pom
Date Wed, 01 Feb 2012 08:19:15 GMT
Then, we should include hama-core only. If we get rid of shade plugin,
the yarn jar file size is only 40kb. As you know, apache.org and
download mirrors are very slow. IMO, 60mb is too big.

Or, user can copy hama jars to ${HADOOP_HOME}/lib or add hama jars
CLASS_PATH simply.

On Wed, Feb 1, 2012 at 5:05 PM, Thomas Jungblut
<thomas.jungblut@googlemail.com> wrote:
> Ah, yes I remember.
> For YARN this is because the hama jars are not in the YARN lib folder.
> When using bin/hadoop jar hama-yarn.jar <some fancy example included> this
> won't work when the dependencies are not included.
> We can just shade the hama jars, and not the rest. Maybe this will be a bit
> more lightweight.
>
> 2012/2/1 Edward J. Yoon <edwardyoon@apache.org>
>
>> JAR files size too big (20mb and 60mb). Moreover, basically, all
>> dependencies are in project lib folder and will be loaded from
>> bin/hama or bin/yarn scripts.
>>
>> If there's a specific reason to package w/ all dependencies, Pls let me
>> know.
>>
>> On Wed, Feb 1, 2012 at 4:54 PM, Thomas Jungblut
>> <thomas.jungblut@googlemail.com> wrote:
>> > why?
>> >
>> > 2012/2/1 Edward J. Yoon <edwardyoon@apache.org>
>> >
>> >> Hi,
>> >>
>> >> In examples and yarn modules' pom, there's a shade-plugin. I'd like to
>> >> get rid of shade option.
>> >>
>> >> What do you think?
>> >>
>> >> --
>> >> Best Regards, Edward J. Yoon
>> >> @eddieyoon
>> >>
>> >
>> >
>> >
>> > --
>> > Thomas Jungblut
>> > Berlin <thomas.jungblut@gmail.com>
>>
>>
>>
>> --
>> Best Regards, Edward J. Yoon
>> @eddieyoon
>>
>
>
>
> --
> Thomas Jungblut
> Berlin <thomas.jungblut@gmail.com>



-- 
Best Regards, Edward J. Yoon
@eddieyoon

Mime
View raw message