Return-Path: Delivered-To: apmail-hadoop-zookeeper-user-archive@minotaur.apache.org Received: (qmail 39824 invoked from network); 16 Mar 2010 00:47:30 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 16 Mar 2010 00:47:30 -0000 Received: (qmail 73342 invoked by uid 500); 16 Mar 2010 00:47:29 -0000 Delivered-To: apmail-hadoop-zookeeper-user-archive@hadoop.apache.org Received: (qmail 73315 invoked by uid 500); 16 Mar 2010 00:47:29 -0000 Mailing-List: contact zookeeper-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: zookeeper-user@hadoop.apache.org Delivered-To: mailing list zookeeper-user@hadoop.apache.org Received: (qmail 73307 invoked by uid 99); 16 Mar 2010 00:47:29 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 16 Mar 2010 00:47:29 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of maxime.caron@gmail.com designates 209.85.223.197 as permitted sender) Received: from [209.85.223.197] (HELO mail-iw0-f197.google.com) (209.85.223.197) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 16 Mar 2010 00:47:23 +0000 Received: by iwn35 with SMTP id 35so400777iwn.2 for ; Mon, 15 Mar 2010 17:47:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:date:message-id:subject :from:to:content-type; bh=BM7NrBzhE7vzLqQl0TXK+ItuM+IVnR5+YWs5wEFSLnw=; b=fzjzvaiKVEDLDfzytPUdbVoM3r31WkSf3EyyoFXIS7iCVbNMYeZD3NV2HuJiAb+Po3 Kyi421WfxucDhfz3DRwickMEjhmk+x1Hnwo1uCbD7zRG+zqB3/docNYPtTjg/FcdhLIm lyH9TrukIvZas4Mg6NbggpiaLSEdu3kkdYtHY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=qMcSP+M3zrpGG44dkH7DHLI+1ZuLsra3unjQNa+rcVgPAJkPrKBSr7kYRh41EMAfK+ DuiLAk3Cm4jzqXvp/3yQZtQjxAjtfD8KH4hRBSX0yTxNcviffLziqohrs/uOApiYwQ1Y 0Qy2sugzq2h29iquaDQ1v7mk5vsdXiT9sH1Dg= MIME-Version: 1.0 Received: by 10.231.173.139 with SMTP id p11mr516340ibz.51.1268700422799; Mon, 15 Mar 2010 17:47:02 -0700 (PDT) Date: Mon, 15 Mar 2010 20:47:02 -0400 Message-ID: <9dba5ed31003151747p48c2892fv57bf94eb4075d1e7@mail.gmail.com> Subject: persistent storage and node recovery From: Maxime Caron To: zookeeper-user@hadoop.apache.org Content-Type: multipart/alternative; boundary=0016367d58580700460481e056fc --0016367d58580700460481e056fc Content-Type: text/plain; charset=ISO-8859-1 Hi everybody, >From what i understand Zookeeper consistency model work the same way as does Scalaris. Which is to keep the majority of the replica for an item UP. In Scalaris i f a single failed node does crash and recover, it simply start like a fresh new node and all data is lost. This is the case because it may otherwise get some inconsistencies as another node already took over. For a short timeframe there might be more replicas in the system than allowed, which destroys the proper functioning of our majority based algorithms. So my question is how Zookeeper use the persistent storage during node recovery, how does the majority based algorithms is different so consistency is preserved. Thanks a lots Maxime Caron --0016367d58580700460481e056fc--