Return-Path: Delivered-To: apmail-incubator-hama-user-archive@minotaur.apache.org Received: (qmail 15228 invoked from network); 3 Feb 2010 08:41:44 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 3 Feb 2010 08:41:44 -0000 Received: (qmail 15525 invoked by uid 500); 3 Feb 2010 08:41:44 -0000 Delivered-To: apmail-incubator-hama-user-archive@incubator.apache.org Received: (qmail 15054 invoked by uid 500); 3 Feb 2010 08:41:43 -0000 Mailing-List: contact hama-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hama-user@incubator.apache.org Delivered-To: mailing list hama-user@incubator.apache.org Received: (qmail 14773 invoked by uid 99); 3 Feb 2010 08:41:43 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Feb 2010 08:41:43 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.9] (HELO minotaur.apache.org) (140.211.11.9) by apache.org (qpsmtpd/0.29) with SMTP; Wed, 03 Feb 2010 08:41:32 +0000 Received: (qmail 15179 invoked by uid 99); 3 Feb 2010 08:41:10 -0000 Received: from localhost.apache.org (HELO ey-out-1920.google.com) (127.0.0.1) (smtp-auth username edwardyoon, mechanism plain) by minotaur.apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Feb 2010 08:41:10 +0000 Received: by ey-out-1920.google.com with SMTP id 26so209164eyw.8 for ; Wed, 03 Feb 2010 00:41:08 -0800 (PST) MIME-Version: 1.0 Received: by 10.216.86.66 with SMTP id v44mr3960776wee.163.1265186468481; Wed, 03 Feb 2010 00:41:08 -0800 (PST) In-Reply-To: <1f3f3bb61002022330l32b867abn9a08b6c959db9839@mail.gmail.com> References: <40360.1265176147@buffalo.edu> <1f3f3bb61002022217m5d530e3awf10021224f22747d@mail.gmail.com> <1f3f3bb61002022330l32b867abn9a08b6c959db9839@mail.gmail.com> Date: Wed, 3 Feb 2010 17:41:08 +0900 Message-ID: Subject: Re: More documentation on Hama- BSP From: "Edward J. Yoon" To: hama-user@incubator.apache.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Hi, >> The synchronization occurs only when peer.sync() is called? Yes, >> I think the needToVisit() function might as well need to communicate >> with other machine: Hmm, You're exactly right. In that example, needToVisit() function checks the IsVisited from some shared-space (e.g., HBase or DBMS, ..., etc). We wrote with intent to simplify it. Integer is the distance at "Map input, Map nextQueue", but it could be replaced as other object. for example, new PathWeHaveFollowed(). Then, perhaps we need not some shared-space. On Wed, Feb 3, 2010 at 4:30 PM, Felix Halim wrote: > One question: > > The synchronization occurs only when peer.sync() is called? > > I think the needToVisit() function might as well need to communicate > with other machine: > > for (Integer i : vertex.getAdjacent()) { > =C2=A0 if (needToVisit(i, vertex, input.get(e.getKey()))) { > > Since the current node might not know the state of Vertex i, it might > need to contact other machine to check the "visited" state. So, is the > synchronization also occur at this step? > > Felix Halim > > On Wed, Feb 3, 2010 at 2:29 PM, Edward J. Yoon wr= ote: >> Hi, >> >> Regarding graph computing, below TP will be helpful for you. >> >> "An Introduction to Bulk Synchronization Parallel on Hadoop" >> http://people.apache.org/~edwardyoon/papers/Apache_HAMA_BSP.pdf >> >> And, there is also a prototype project, a graph computing framework >> based on BSP. >> http://people.apache.org/~edwardyoon/hamburg_poc.zip >> >> On Wed, Feb 3, 2010 at 3:17 PM, Felix Halim wrot= e: >>> Hi Edward, >>> >>> I also like to know how Hama's BSP can be used on Graphs. >>> Can you send me some docs about it? >>> >>> Thanks, >>> >>> Felix Halim >>> >>> On Wed, Feb 3, 2010 at 2:11 PM, Edward J. Yoon = wrote: >>>> Sure, I'll share it with you. >>>> >>>> On Wed, Feb 3, 2010 at 2:49 PM, =C2=A0 wrote: >>>>> Hi Edward, >>>>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Could you send me some documentatio= n regarding BSP- Hama especially how >>>>> it can be used for performing operations on matrices ? >>>>> >>>>> Best Regards from Buffalo >>>>> >>>>> Abhishek Agrawal >>>>> >>>>> SUNY- Buffalo >>>>> (716-435-7122) >>>>> >>>>> >>>>> >>>>> >>>> >>>> >>>> >>>> -- >>>> Best Regards, Edward J. Yoon @ NHN, corp. >>>> edwardyoon@apache.org >>>> http://blog.udanax.org >>>> >>> >> >> >> >> -- >> Best Regards, Edward J. Yoon @ NHN, corp. >> edwardyoon@apache.org >> http://blog.udanax.org >> > --=20 Best Regards, Edward J. Yoon @ NHN, corp. edwardyoon@apache.org http://blog.udanax.org