Return-Path: X-Original-To: apmail-incubator-hama-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-hama-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C2C3893F0 for ; Thu, 8 Dec 2011 02:31:21 +0000 (UTC) Received: (qmail 93823 invoked by uid 500); 8 Dec 2011 02:31:21 -0000 Delivered-To: apmail-incubator-hama-dev-archive@incubator.apache.org Received: (qmail 93795 invoked by uid 500); 8 Dec 2011 02:31:21 -0000 Mailing-List: contact hama-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hama-dev@incubator.apache.org Delivered-To: mailing list hama-dev@incubator.apache.org Received: (qmail 93786 invoked by uid 99); 8 Dec 2011 02:31:21 -0000 Received: from minotaur.apache.org (HELO minotaur.apache.org) (140.211.11.9) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 Dec 2011 02:31:21 +0000 Received: from localhost (HELO mail-iy0-f175.google.com) (127.0.0.1) (smtp-auth username edwardyoon, mechanism plain) by minotaur.apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 Dec 2011 02:31:21 +0000 Received: by iadj38 with SMTP id j38so1837808iad.6 for ; Wed, 07 Dec 2011 18:31:20 -0800 (PST) MIME-Version: 1.0 Received: by 10.42.159.72 with SMTP id k8mr1609821icx.14.1323311480637; Wed, 07 Dec 2011 18:31:20 -0800 (PST) Received: by 10.50.135.73 with HTTP; Wed, 7 Dec 2011 18:31:20 -0800 (PST) In-Reply-To: References: Date: Thu, 8 Dec 2011 11:31:20 +0900 Message-ID: Subject: Re: Add counting feature to get the total number of message exchanges From: "Edward J. Yoon" To: hama-dev@incubator.apache.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable All, Please check this issue: https://issues.apache.org/jira/browse/HAMA-486 On Fri, Nov 25, 2011 at 11:16 AM, Chia-Hung Lin wro= te: > +1 for pluggable feature/ =C2=A0hadoop's counter arch > > On 25 November 2011 01:05, Thomas Jungblut > wrote: >> Great, I open an issue for this counter stuff. >> >> 2011/11/24 Edward J. Yoon >> >>> >> I think it would be good as a 'pluggable' feature as this counting >>> could>> impact performances. >>> and >>> >>> > It is difficult to say whether we actually need this.* >>> > *In case of SSSP it is useful, but as Tommaso says it can degrade >>> >>> I agree with you. If possible, let's provide as a optional feature. >>> >>> > What do you think of a similar architecture of Counters like in Hadoo= p? >>> >>> Good. >>> >>> Currently, our Job client reports only shows the total number of >>> supersteps. I think that the Job reports needs to be strengthened. :-) >>> >>> On Thu, Nov 24, 2011 at 11:05 PM, Thomas Jungblut >>> wrote: >>> > It is difficult to say whether we actually need this.* >>> > *In case of SSSP it is useful, but as Tommaso says it can degrade >>> > performance for every other BSP by increasing the cost of the sync. >>> > >>> > What do you think of a similar architecture of Counters like in Hadoo= p? >>> > This could contain even more information, e.G. the number of bytes >>> > transferred etc. >>> > >>> > 2011/11/24 Tommaso Teofili >>> > >>> >> Hello Edward, >>> >> >>> >> I think it would be good as a 'pluggable' feature as this counting c= ould >>> >> impact performances. >>> >> So it'd be useful when explicitly "debugging" while it should be, in= my >>> >> opinion, disabled by default. >>> >> >>> >> My 2 cents. >>> >> Tommaso >>> >> >>> >> >>> >> 2011/11/24 Edward J. Yoon >>> >> >>> >> > Hi all, >>> >> > >>> >> > I'd like to add counting feature to get the total number of messag= e >>> >> > exchanges during one synchronization among BSP tasks. Before leave >>> >> > barrier in sync() method, each task can report their counts. >>> >> > >>> >> > This information will be useful to user and, some applications (fo= r >>> >> > example, the sync cost of current SSSP example can be reduced to 1= /3). >>> >> > Should we add this feature? >>> >> > >>> >> > -- >>> >> > Best Regards, Edward J. Yoon >>> >> > @eddieyoon >>> >> > >>> >> >>> > >>> > >>> > >>> > -- >>> > Thomas Jungblut >>> > Berlin >>> > >>> >>> >>> >>> -- >>> Best Regards, Edward J. Yoon >>> @eddieyoon >>> >> >> >> >> -- >> Thomas Jungblut >> Berlin >> --=20 Best Regards, Edward J. Yoon @eddieyoon