Return-Path: X-Original-To: apmail-incubator-hama-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-hama-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 725EF97C6 for ; Fri, 23 Sep 2011 14:02:06 +0000 (UTC) Received: (qmail 65083 invoked by uid 500); 23 Sep 2011 14:02:06 -0000 Delivered-To: apmail-incubator-hama-dev-archive@incubator.apache.org Received: (qmail 65063 invoked by uid 500); 23 Sep 2011 14:02:06 -0000 Mailing-List: contact hama-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hama-dev@incubator.apache.org Delivered-To: mailing list hama-dev@incubator.apache.org Received: (qmail 65055 invoked by uid 99); 23 Sep 2011 14:02:06 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 23 Sep 2011 14:02:06 +0000 X-ASF-Spam-Status: No, hits=4.0 required=5.0 tests=FREEMAIL_FROM,FREEMAIL_REPLY,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_FILL_THIS_FORM_SHORT,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of thomas.jungblut@googlemail.com designates 209.85.212.47 as permitted sender) Received: from [209.85.212.47] (HELO mail-vw0-f47.google.com) (209.85.212.47) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 23 Sep 2011 14:02:00 +0000 Received: by vwe42 with SMTP id 42so3251010vwe.6 for ; Fri, 23 Sep 2011 07:01:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=pAWwYvs5I6VRsGbXlL0Y6tSjNfLcpixkubhy2wV7vaM=; b=ZR7cj4CRHwFN7CtubMuhQS/5SO2olqQpgRvdtgO9qr1ojaemK1ELoT7w4NGnLn3Bj+ KmJZ3u6BCeERZvJw+k3XjCAZ/NeaYikhbF2ak0YwahmXEZl4oD23bsoObA9qPWVkNdP5 nb5+P7ErsxMjnPIiMvtQv/qxUHia+96F8Aigo= MIME-Version: 1.0 Received: by 10.52.108.105 with SMTP id hj9mr3134008vdb.350.1316786499032; Fri, 23 Sep 2011 07:01:39 -0700 (PDT) Received: by 10.52.187.136 with HTTP; Fri, 23 Sep 2011 07:01:38 -0700 (PDT) In-Reply-To: References: Date: Fri, 23 Sep 2011 16:01:38 +0200 Message-ID: Subject: Re: Hang problem From: Thomas Jungblut To: hama-dev@incubator.apache.org Content-Type: multipart/alternative; boundary=bcaec5485cfc8517fe04ad9c3f14 X-Virus-Checked: Checked by ClamAV on apache.org --bcaec5485cfc8517fe04ad9c3f14 Content-Type: text/plain; charset=ISO-8859-1 I have made a github for that: https://github.com/thomasjungblut/barriersync Check it out into your eclipse (the root directory failed for whatever reason). Start the server and then the clientemulator. Works like a real charm. Please consider this as an alternative. We should not roll out a 4.0 release with a not working barrier sync. 2011/9/23 Thomas Jungblut > Won't much different. >> > > Let's see. > > 2011/9/23 Edward J. Yoon > >> What happens if some task no longer need to communicate with others? >> >> I didn't look at the code recently but I guess that the problem is >> related with comparison of znode size and task size. >> >> > I am going to write a RPC barrier sync. Zookeeper sucks in this case. >> >> Won't much different. Let's focusing on NG integration and In/Output >> system. >> >> On Fri, Sep 23, 2011 at 8:21 PM, Thomas Jungblut >> wrote: >> > I am going to write a RPC barrier sync. Zookeeper sucks in this case. >> > >> > 2011/9/23 Edward J. Yoon >> > >> >> P.S., Tested on 16 nodes using 10 tasks per node. >> >> >> >> On Fri, Sep 23, 2011 at 7:19 PM, Edward J. Yoon > > >> >> wrote: >> >> > Hi, >> >> > >> >> > Today I ran the sssp example with 4GB sample file. >> >> > >> >> > At 32th step, some tasks are finished and others hang forever. >> >> > >> >> > Could anyone figure out this problem? >> >> > >> >> > Plus, there're too many INFO-level logs. Let's reduce them. >> >> > >> >> > Thanks. >> >> > >> >> > -- >> >> > Best Regards, Edward J. Yoon >> >> > @eddieyoon >> >> > >> >> >> >> >> >> >> >> -- >> >> Best Regards, Edward J. Yoon >> >> @eddieyoon >> >> >> > >> > >> > >> > -- >> > Thomas Jungblut >> > Berlin >> > >> > mobile: 0170-3081070 >> > >> > business: thomas.jungblut@testberichte.de >> > private: thomas.jungblut@gmail.com >> > >> >> >> >> -- >> Best Regards, Edward J. Yoon >> @eddieyoon >> > > > > -- > Thomas Jungblut > Berlin > > mobile: 0170-3081070 > > business: thomas.jungblut@testberichte.de > private: thomas.jungblut@gmail.com > -- Thomas Jungblut Berlin mobile: 0170-3081070 business: thomas.jungblut@testberichte.de private: thomas.jungblut@gmail.com --bcaec5485cfc8517fe04ad9c3f14--