Return-Path: X-Original-To: apmail-hama-dev-archive@www.apache.org Delivered-To: apmail-hama-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0367511CE0 for ; Fri, 19 Sep 2014 14:53:32 +0000 (UTC) Received: (qmail 31493 invoked by uid 500); 19 Sep 2014 14:53:31 -0000 Delivered-To: apmail-hama-dev-archive@hama.apache.org Received: (qmail 31460 invoked by uid 500); 19 Sep 2014 14:53:31 -0000 Mailing-List: contact dev-help@hama.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hama.apache.org Delivered-To: mailing list dev@hama.apache.org Received: (qmail 31449 invoked by uid 99); 19 Sep 2014 14:53:31 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 19 Sep 2014 14:53:31 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of andronat_asf@hotmail.com designates 65.55.111.150 as permitted sender) Received: from [65.55.111.150] (HELO BLU004-OMC4S11.hotmail.com) (65.55.111.150) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 19 Sep 2014 14:53:25 +0000 Received: from BLU436-SMTP70 ([65.55.111.136]) by BLU004-OMC4S11.hotmail.com over TLS secured channel with Microsoft SMTPSVC(7.5.7601.22724); Fri, 19 Sep 2014 07:53:04 -0700 X-TMN: [WHs+aC2SL0f/kzg8BfDbck+HU9sqC8OEY+0H+yvofm8=] X-Originating-Email: [andronat_asf@hotmail.com] Message-ID: Received: from pb-d-128-141-153-235.cern.ch ([128.141.153.235]) by BLU436-SMTP70.smtp.hotmail.com over TLS secured channel with Microsoft SMTPSVC(8.0.9200.16384); Fri, 19 Sep 2014 07:53:02 -0700 From: Andronidis Anastasios Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Subject: MapWritable is really bad Date: Fri, 19 Sep 2014 16:52:58 +0200 To: dev@hama.apache.org MIME-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) X-Mailer: Apple Mail (2.1878.6) X-OriginalArrivalTime: 19 Sep 2014 14:53:02.0322 (UTC) FILETIME=[6950FD20:01CFD419] X-Virus-Checked: Checked by ClamAV on apache.org Hello, I remember a discussion rose upon performance issues on messages and = that kryo serializer helped a lot. Please read this: = http://www.chrisstucchio.com/blog/2011/mapwritable_sometimes_a_performance= _hog.html =46rom a custom test I did, I was sending some messages with MapWritable = as a container, Text as key and ArrayWritable (with integers inside) as = a value. Hama was reporting 20MB of traffic. When I wrote my own Map = (that implements Writable interface) I reduced the amount from 20MB to = 1.5MB.. Cheers, Anastasios=