Return-Path: X-Original-To: apmail-hama-dev-archive@www.apache.org Delivered-To: apmail-hama-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9AB81105C3 for ; Fri, 3 Jan 2014 05:04:36 +0000 (UTC) Received: (qmail 53339 invoked by uid 500); 3 Jan 2014 05:04:34 -0000 Delivered-To: apmail-hama-dev-archive@hama.apache.org Received: (qmail 53306 invoked by uid 500); 3 Jan 2014 05:04:27 -0000 Mailing-List: contact dev-help@hama.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hama.apache.org Delivered-To: mailing list dev@hama.apache.org Received: (qmail 53296 invoked by uid 99); 3 Jan 2014 05:04:25 -0000 Received: from minotaur.apache.org (HELO minotaur.apache.org) (140.211.11.9) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Jan 2014 05:04:25 +0000 Received: from localhost (HELO mail-ig0-f170.google.com) (127.0.0.1) (smtp-auth username edwardyoon, mechanism plain) by minotaur.apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Jan 2014 05:04:25 +0000 Received: by mail-ig0-f170.google.com with SMTP id k19so367107igc.1 for ; Thu, 02 Jan 2014 21:04:24 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type:content-transfer-encoding; bh=4yl32TRB+0XVIb80uY9/lHCOVYFqJ53pvfZWMynIQuU=; b=WmBvqhzSGPib0yV5szK4PHPkbqF9gRPC+HpJzhrQGKiVYaYuX38LGtq8Z2ye79yDG0 IxY+8kJBxvlXOGyRmBIwh3V0Kc+QWgFaI/os3wrX7Tg5k25ApuOAJWrYw6LXQ0ANBvl3 W0q5dYuzlMHQ0mMBQeIWXq8UPE780W1m+8bckSHCXOEYQNTJs4EH8KuYEv1fLt3w2qtT mK6rlFbgKqXirLdoGliQIcYxAtjQnh8lAHPRlDFOqOzMzcjFXHJ6/CdBZYbtL/zdK4KI gnACCz7v4d+6/FyDAmt6SJby9r91oczo65TchYWh1IRMwLl3blAWyCJaJq6wOrzjZbTC 2jgw== X-Gm-Message-State: ALoCoQlKT6mMVhlYPfq233rexo4okrVUKMTcBBRBpDvofwH71UP1wEYhZpjxsKFFPJjDRhlQI0lf MIME-Version: 1.0 X-Received: by 10.42.24.210 with SMTP id x18mr42563212icb.38.1388725464795; Thu, 02 Jan 2014 21:04:24 -0800 (PST) Received: by 10.64.71.39 with HTTP; Thu, 2 Jan 2014 21:04:24 -0800 (PST) In-Reply-To: References: <34B9BCCD-0D1F-4FFE-B6AA-6A9CC9C23955@apache.org> <2BA9A0BC-0174-44F4-A3DC-2BB575444C73@apache.org> Date: Fri, 3 Jan 2014 14:04:24 +0900 Message-ID: Subject: Re: Website Update From: "Edward J. Yoon" To: "dev@hama.apache.org" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable I found another bug in Graph package and SemiClustering example. If setup() method should be called once at the start of the program, below variables should be declared as a static (purly class variables). Otherwise, it won't work with DiskVerticesInfo or Serialization version. {code} private int semiClusterMaximumVertexCount; private int graphJobMessageSentCount; private int graphJobVertexMaxClusterCount; @Override public void setup(HamaConfiguration conf) { semiClusterMaximumVertexCount =3D conf.getInt("semicluster.max.vertex.count", 10); graphJobMessageSentCount =3D conf.getInt("semicluster.max.message.sent.count", 10); graphJobVertexMaxClusterCount =3D conf.getInt("vertex.max.cluster.count= ", 10); } {code} On Fri, Jan 3, 2014 at 11:28 AM, Edward J. Yoon wro= te: > Almost fixed. > > 1. http://markmail.org/thread/vv4z3gskfms6bhix > 2. HAMA-821 > > Graph examples still has memory issue. > > On Fri, Jan 3, 2014 at 11:03 AM, Yexi Jiang wrote: >> Is there any details about the test results? >> >> >> 2014/1/2 Edward J. Yoon >> >>> Input was too small :/ So, I'll update website using confident benchmar= ks >>> soon. >>> >>> https://twitter.com/tjungblut/status/414717432293363712 >>> >>> After I saw this tweet, I thought we need to update the website. Many >>> people seems think that hama is a graph processing framework. If you >>> have some good idea, Please let me know. >>> >>> P.S., I recently tested Hama examples and 80% of them didn't work. >>> Let's fix them all in 0.7 release and update the website clearly. >>> >>> >>> On Thu, Jan 2, 2014 at 11:55 PM, Tommaso Teofili >>> wrote: >>> > Hi all, >>> > >>> > I just noticed that the graph on our homepage [0] looks very similar = to >>> the >>> > one on Spark homepage [1] so I wonder if we could at least make it a = bit >>> > clearer either by writing the benchmarks results in a table near it (= it >>> > seems Hama always takes ~0) or something else I cannot think to right >>> now. >>> > >>> > The reference to the benchmarks wiki page is ok but I cannot find the >>> entry >>> > for the comparison with Mahout, maybe I'm missing something ... >>> > Regards and happy new year everyone. >>> > Tommaso >>> > >>> > [0] : http://hama.apache.org/images/mahout_vs_hama.png >>> > [1] : http://spark.incubator.apache.org/images/spark-lr.png >>> > >>> > >>> > 2013/12/20 Edward J. Yoon >>> > >>> >> Hi all, >>> >> >>> >> I published new website for our community. If you have other ideas, >>> please >>> >> feel free to share your comments or file a JIRA ticket. >>> >> >>> >> >>> >> On Fri, Dec 20, 2013 at 11:29 AM, Edward J. Yoon >> >> >wrote: >>> >> >>> >> > Thanks, I'll. >>> >> > >>> >> > Sent from my iPhone >>> >> > >>> >> > > On 2013. 12. 19., at =EC=98=A4=ED=9B=84 10:41, Yexi Jiang >>> wrote: >>> >> > > >>> >> > > Hi, >>> >> > > >>> >> > > It looks nice. Is it possible to add more description to the fig= ure? >>> >> When >>> >> > > people first saw this, they may not know what the x axis is (the >>> number >>> >> > of >>> >> > > cores or the number of the number of groom servers?). Moreover, = it >>> is >>> >> > > better to tell the reader some specs of the dataset used. >>> >> > > >>> >> > > Regards, >>> >> > > Yexi >>> >> > > >>> >> > > >>> >> > > 2013/12/19 Edward J. Yoon >>> >> > > >>> >> > >> Thank you so much! >>> >> > >> >>> >> > >> Sent from my iPhone >>> >> > >> >>> >> > >>>> On 2013. 12. 19., at =EC=98=A4=ED=9B=84 4:45, Tommaso Teofili= < >>> >> > tommaso.teofili@gmail.com> >>> >> > >>> wrote: >>> >> > >>> >>> >> > >>> Hi Edward, >>> >> > >>> >>> >> > >>> I think it generally looks better than the current one, I woul= d >>> just >>> >> > >> change >>> >> > >>> this: >>> >> > >>> >>> >> > >>> Many data analysis techniques such as machine learning and gra= ph >>> >> > >> algorithms >>> >> > >>> require iterative computations but MapReduce model doesn't fit= for >>> >> > these >>> >> > >>> iterative data analysis applications. To run these iterative d= ata >>> >> > >> analysis >>> >> > >>> applications more efficiently, Hama offers pure Bulk Synchrono= us >>> >> > Parallel >>> >> > >>> computing engine. >>> >> > >>> >>> >> > >>> >>> >> > >>> to something like this: >>> >> > >>> >>> >> > >>> Many data analysis techniques such as machine learning and gra= ph >>> >> > >> algorithms >>> >> > >>> require iterative computations, this is where Bulk Synchronous >>> >> Parallel >>> >> > >>> model can be more effective than "plain" MapReduce. Therefore = to >>> run >>> >> > such >>> >> > >>> iterative data analysis applications more efficiently, Hama of= fers >>> >> pure >>> >> > >>> Bulk Synchronous Parallel computing engine. >>> >> > >>> >>> >> > >>> >>> >> > >>> As I wouldn't say MR is inherently not good for iterative >>> >> computations, >>> >> > >>> just BSP can be a better / more perfomant alternative. >>> >> > >>> My 2 cents, >>> >> > >>> Tommaso >>> >> > >>> >>> >> > >>> >>> >> > >>> 2013/12/19 Edward J. Yoon >>> >> > >>> >>> >> > >>>> Hi, >>> >> > >>>> >>> >> > >>>> I've made some changes to our website - >>> >> > >>>> http://people.apache.org/~edwardyoon/site/ - Please review an= d >>> >> > feedback >>> >> > >>>> here. >>> >> > >>>> >>> >> > >>>> -- >>> >> > >>>> Best Regards, Edward J. Yoon >>> >> > >>>> @eddieyoon >>> >> > > >>> >> > > >>> >> > > >>> >> > > -- >>> >> > > ------ >>> >> > > Yexi Jiang, >>> >> > > ECS 251, yjian004@cs.fiu.edu >>> >> > > School of Computer and Information Science, >>> >> > > Florida International University >>> >> > > Homepage: http://users.cis.fiu.edu/~yjian004/ >>> >> > >>> >> >>> >> >>> >> >>> >> -- >>> >> Best Regards, Edward J. Yoon >>> >> @eddieyoon >>> >> >>> >>> >>> >>> -- >>> Best Regards, Edward J. Yoon >>> @eddieyoon >>> >> >> >> >> -- >> ------ >> Yexi Jiang, >> ECS 251, yjian004@cs.fiu.edu >> School of Computer and Information Science, >> Florida International University >> Homepage: http://users.cis.fiu.edu/~yjian004/ > > > > -- > Best Regards, Edward J. Yoon > @eddieyoon --=20 Best Regards, Edward J. Yoon @eddieyoon