hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon" <edwardy...@apache.org>
Subject Re: MapWritable is really bad
Date Wed, 24 Sep 2014 09:19:17 GMT
Interesting ..

On Fri, Sep 19, 2014 at 11:52 PM, Andronidis Anastasios
<andronat_asf@hotmail.com> wrote:
> Hello,
>
> I remember a discussion rose upon performance issues on messages and that kryo serializer
helped a lot.
>
> Please read this: http://www.chrisstucchio.com/blog/2011/mapwritable_sometimes_a_performance_hog.html
>
> From a custom test I did, I was sending some messages with MapWritable as a container,
Text as key and ArrayWritable (with integers inside) as a value. Hama was reporting 20MB of
traffic. When I wrote my own Map (that implements Writable interface) I reduced the amount
from 20MB to 1.5MB..
>
> Cheers,
> Anastasios



-- 
Best Regards, Edward J. Yoon
CEO at DataSayer Co., Ltd.

Mime
View raw message