Return-Path: X-Original-To: apmail-incubator-hama-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-hama-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 990752C13 for ; Thu, 21 Apr 2011 13:31:42 +0000 (UTC) Received: (qmail 84134 invoked by uid 500); 21 Apr 2011 13:31:42 -0000 Delivered-To: apmail-incubator-hama-dev-archive@incubator.apache.org Received: (qmail 84111 invoked by uid 500); 21 Apr 2011 13:31:42 -0000 Mailing-List: contact hama-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hama-dev@incubator.apache.org Delivered-To: mailing list hama-dev@incubator.apache.org Received: (qmail 84103 invoked by uid 99); 21 Apr 2011 13:31:42 -0000 Received: from minotaur.apache.org (HELO minotaur.apache.org) (140.211.11.9) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 21 Apr 2011 13:31:42 +0000 Received: from localhost (HELO mail-iw0-f175.google.com) (127.0.0.1) (smtp-auth username edwardyoon, mechanism plain) by minotaur.apache.org (qpsmtpd/0.29) with ESMTP; Thu, 21 Apr 2011 13:31:42 +0000 Received: by iwn10 with SMTP id 10so1593861iwn.6 for ; Thu, 21 Apr 2011 06:31:41 -0700 (PDT) MIME-Version: 1.0 Received: by 10.231.81.18 with SMTP id v18mr2792081ibk.42.1303392701287; Thu, 21 Apr 2011 06:31:41 -0700 (PDT) Received: by 10.231.19.3 with HTTP; Thu, 21 Apr 2011 06:31:41 -0700 (PDT) In-Reply-To: <878489054.73100.1303374305723.JavaMail.tomcat@hel.zones.apache.org> References: <1200254649.64627.1303141625881.JavaMail.tomcat@hel.zones.apache.org> <878489054.73100.1303374305723.JavaMail.tomcat@hel.zones.apache.org> Date: Thu, 21 Apr 2011 22:31:41 +0900 Message-ID: Subject: Re: [jira] [Commented] (HAMA-380) Send messages in batches to reduce RPC overhead. From: "Edward J. Yoon" To: hama-dev@incubator.apache.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Oh, my mistake. I've just committed your patch. Thanks thomas! On Thu, Apr 21, 2011 at 5:25 PM, Edward J. Yoon (JIRA) wr= ote: > > =C2=A0 =C2=A0[ https://issues.apache.org/jira/browse/HAMA-380?page=3Dcom.= atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedComment= Id=3D13022684#comment-13022684 ] > > Edward J. Yoon commented on HAMA-380: > ------------------------------------- > > Please update your source code to latest TRUNK. Miklos Erdelyi's patch is= already committed. > > > >> Send messages in batches to reduce RPC overhead. >> ------------------------------------------------ >> >> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 Key: HAMA-380 >> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 URL: https://iss= ues.apache.org/jira/browse/HAMA-380 >> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 Project: Hama >> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Issue Type: Improvement >> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Components: bsp >> =C2=A0 =C2=A0Affects Versions: 0.3.0 >> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Reporter: Miklos Erdelyi >> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Assignee: Miklos Erdelyi >> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 Fix For: 0.3.0 >> >> =C2=A0 =C2=A0 =C2=A0 =C2=A0 Attachments: HAMA-380-v2.patch, bspmsgbundle= .patch, bspmsgbundle.v2.patch >> >> =C2=A0 Original Estimate: 4h >> =C2=A0Remaining Estimate: 4h >> >> When profiling graph computations running on HAMA it turned out that hug= e amount of time is spent in RPC calls. >> To reduce this overhead I propose extending the GroomServer's API with a= put(BSPMessageBundle) method so that a group of messages can be transferre= d from the caller to the callee at once. Also, the sync() operation should = be improved by sending messages in batches rather than one-by-one. >> Using BSPMessageBundle makes it easier to add support for compression of= messages later. > > -- > This message is automatically generated by JIRA. > For more information on JIRA, see: http://www.atlassian.com/software/jira > --=20 Best Regards, Edward J. Yoon http://blog.udanax.org http://twitter.com/eddieyoon