Return-Path: X-Original-To: apmail-zookeeper-user-archive@www.apache.org Delivered-To: apmail-zookeeper-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 07E809CF1 for ; Tue, 20 Sep 2011 00:53:23 +0000 (UTC) Received: (qmail 43685 invoked by uid 500); 20 Sep 2011 00:53:22 -0000 Delivered-To: apmail-zookeeper-user-archive@zookeeper.apache.org Received: (qmail 43638 invoked by uid 500); 20 Sep 2011 00:53:22 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Received: (qmail 43628 invoked by uid 99); 20 Sep 2011 00:53:22 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 20 Sep 2011 00:53:22 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ted.dunning@gmail.com designates 209.85.216.49 as permitted sender) Received: from [209.85.216.49] (HELO mail-qw0-f49.google.com) (209.85.216.49) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 20 Sep 2011 00:53:16 +0000 Received: by qwi2 with SMTP id 2so24839qwi.8 for ; Mon, 19 Sep 2011 17:52:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=z9zP7iuTbmnf8wmtYJhzfDBQv1ZkAMrlS4qec9Zv1Ek=; b=rEvGEfgdODWDG5j/GWo+qBYXyPahthPN836SeHqo610GK+yun9ZhANCXmcce/j9Wqu XgKplqWs1vXeGmwpB+SrcV7D3NamvyIBLwi7l3B+ynHrm2s/VdxAKtTelejW9NxelEO5 hbYwGnPG1juP9nRssg7cvpk4qxVDkbXOqD0sY= Received: by 10.224.188.7 with SMTP id cy7mr111321qab.327.1316479975066; Mon, 19 Sep 2011 17:52:55 -0700 (PDT) MIME-Version: 1.0 Received: by 10.224.89.13 with HTTP; Mon, 19 Sep 2011 17:52:34 -0700 (PDT) In-Reply-To: References: From: Ted Dunning Date: Mon, 19 Sep 2011 18:52:34 -0600 Message-ID: Subject: Re: Distributed locks for global barrier synchronization To: user@zookeeper.apache.org Cc: hama-dev@incubator.apache.org Content-Type: multipart/alternative; boundary=485b397dd47b448df304ad54e129 --485b397dd47b448df304ad54e129 Content-Type: text/plain; charset=UTF-8 Conceptually, it might be good to have two barriers, one for the beginning of a computation and one for the end. The first barrier is guaranteed not to have the fast finish characteristic because all nodes are already in the before-start state. On Mon, Sep 19, 2011 at 6:04 PM, Edward J. Yoon wrote: > Thanks. > > And, we found this - https://issues.apache.org/jira/browse/ZOOKEEPER-1011 > > On Thu, Sep 8, 2011 at 3:06 PM, Ted Dunning wrote: > > It might help to have a different znode for synchronization at each > > iteration. That way, if slow nodes are still just getting around to > > deleting the old node, the fast nodes creating their new nodes will not > > interfere. > > > > On Wed, Sep 7, 2011 at 7:01 PM, Edward J. Yoon >wrote: > > > >> Hi, > >> > >> I'm using Zookeeper for global barrier synchronization of Hama BSP > >> computing engine. Current implementation is based on 'ZooKeeper > >> Recipes and Solutions'[1] but there's a problem. > >> > >> The problem is that, before the last process leaving the barrier > >> completely, other processors are starting to create their node[2]. So, > >> that last process hangs forever at "2. if no children, exit" step. > >> This problem intermittently occurs on high-performance environments. > >> > >> Can anyone advise me? > >> > >> 1. http://zookeeper.apache.org/doc/trunk/recipes.html > >> 2. > >> > https://issues.apache.org/jira/browse/HAMA-387?focusedCommentId=13037785&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13037785 > >> > >> -- > >> Best Regards, Edward J. Yoon > >> @eddieyoon > >> > > > > > > -- > Best Regards, Edward J. Yoon > @eddieyoon > --485b397dd47b448df304ad54e129--