Return-Path: Delivered-To: apmail-hadoop-zookeeper-user-archive@minotaur.apache.org Received: (qmail 2484 invoked from network); 20 Oct 2010 22:28:46 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 20 Oct 2010 22:28:46 -0000 Received: (qmail 28101 invoked by uid 500); 20 Oct 2010 22:28:45 -0000 Delivered-To: apmail-hadoop-zookeeper-user-archive@hadoop.apache.org Received: (qmail 28084 invoked by uid 500); 20 Oct 2010 22:28:45 -0000 Mailing-List: contact zookeeper-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: zookeeper-user@hadoop.apache.org Delivered-To: mailing list zookeeper-user@hadoop.apache.org Received: (qmail 28076 invoked by uid 99); 20 Oct 2010 22:28:45 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 20 Oct 2010 22:28:45 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of ted.dunning@gmail.com designates 74.125.82.48 as permitted sender) Received: from [74.125.82.48] (HELO mail-ww0-f48.google.com) (74.125.82.48) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 20 Oct 2010 22:28:38 +0000 Received: by wwb18 with SMTP id 18so3276507wwb.29 for ; Wed, 20 Oct 2010 15:28:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:mime-version:received:in-reply-to :references:from:date:message-id:subject:to:content-type; bh=vv6Jqt+0SvJkWC1+4/UhHJ73oVbm7edC1++lkczsmZQ=; b=RAqPYVIdbR2AV1GWnsxHE1jGXfHwbeZKVM9zO/+JXG4KCPtyMo4E2A0+Gurq1/6Cqd myiX2eFzEVapY+7AUqOQp6Ff03YKH0uz0/prJc9aV3nadSRP7z7AzB8Ek+KoYAuU4D+P ZHQkAeJHZki3KlHQk3MuQ3+xwkBJWmmit0tSQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; b=lyf9nSZXgMonPC/iBWuI4BEpHd0T191xOz7lgaBoMfjBNkBRihYvVG3gjQwK+fHJqL C8FOwnL2To3XnPZs1kH2a2aFWhGyIHYXFdRQ3Jk1OejegnaBg1kAx8TWTYIBGucPvJko oaAXU9oSUT2yp8Pz/npRIQAU9FbZlfAgKK+Gc= Received: by 10.216.13.207 with SMTP id b57mr109735web.32.1287613697739; Wed, 20 Oct 2010 15:28:17 -0700 (PDT) MIME-Version: 1.0 Received: by 10.216.183.129 with HTTP; Wed, 20 Oct 2010 15:27:57 -0700 (PDT) In-Reply-To: References: From: Ted Dunning Date: Wed, 20 Oct 2010 15:27:57 -0700 Message-ID: Subject: Re: Retrying sequential znode creation To: zookeeper-user@hadoop.apache.org Content-Type: multipart/alternative; boundary=0016364d26cf0fcae7049313ed04 X-Virus-Checked: Checked by ClamAV on apache.org --0016364d26cf0fcae7049313ed04 Content-Type: text/plain; charset=UTF-8 These corner cases are relatively rare, I would think (I personally keep logs around for days or longer). Would it be possible to get a partial solution in place that invokes the current behavior if logs aren't available? On Wed, Oct 20, 2010 at 10:42 AM, Patrick Hunt wrote: > Hi Ted, Mahadev is in the best position to comment (he looked at it last) > but iirc when we started looking into implementing this we immediately ran > into so big questions. One was what to do if the logs had been cleaned up > and the individual transactions no longer available. This could be overcome > by changes wrt cleanup, log rotation, etc... There was another more > bulletproof option, essentially to keep all the changes in memory that > might > be necessary to implement 22, however this might mean a significant > increase > in mem requirements and general bookkeeping. It turned out (again correct > me > if I'm wrong) that more thought was going to be necessary, esp around > ensuring correct operation in any/all special cases. > > Patrick > > On Wed, Oct 13, 2010 at 12:49 PM, Ted Dunning > wrote: > > > Patrick, > > > > What are these hurdles? The last comment on ZK-22 was last winter. Back > > then, it didn't sound like > > it was going to be that hard. > > > > On Wed, Oct 13, 2010 at 12:08 PM, Patrick Hunt wrote: > > > > > 22 would help with this issue > > > https://issues.apache.org/jira/browse/ZOOKEEPER-22 > > > however there are some real hurdles to implementing 22 successfully. > > > > > > --0016364d26cf0fcae7049313ed04--