hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andronidis Anastasios <andronat_...@hotmail.com>
Subject MapWritable is really bad
Date Fri, 19 Sep 2014 14:52:58 GMT

I remember a discussion rose upon performance issues on messages and that kryo serializer
helped a lot.

Please read this: http://www.chrisstucchio.com/blog/2011/mapwritable_sometimes_a_performance_hog.html

From a custom test I did, I was sending some messages with MapWritable as a container, Text
as key and ArrayWritable (with integers inside) as a value. Hama was reporting 20MB of traffic.
When I wrote my own Map (that implements Writable interface) I reduced the amount from 20MB
to 1.5MB..

View raw message