Return-Path: Delivered-To: apmail-hadoop-zookeeper-commits-archive@locus.apache.org Received: (qmail 82019 invoked from network); 3 Oct 2008 23:23:12 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 3 Oct 2008 23:23:12 -0000 Received: (qmail 79755 invoked by uid 500); 3 Oct 2008 23:23:11 -0000 Delivered-To: apmail-hadoop-zookeeper-commits-archive@hadoop.apache.org Received: (qmail 79732 invoked by uid 500); 3 Oct 2008 23:23:11 -0000 Mailing-List: contact zookeeper-commits-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: zookeeper-dev@ Delivered-To: mailing list zookeeper-commits@hadoop.apache.org Received: (qmail 79721 invoked by uid 99); 3 Oct 2008 23:23:11 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Oct 2008 16:23:11 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO eris.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Oct 2008 23:22:16 +0000 Received: by eris.apache.org (Postfix, from userid 65534) id EC59E23888F4; Fri, 3 Oct 2008 16:22:21 -0700 (PDT) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r701566 - in /hadoop/zookeeper/trunk: CHANGES.txt src/docs/src/documentation/content/xdocs/zookeeperOver.xml Date: Fri, 03 Oct 2008 23:22:21 -0000 To: zookeeper-commits@hadoop.apache.org From: phunt@apache.org X-Mailer: svnmailer-1.0.8 Message-Id: <20081003232221.EC59E23888F4@eris.apache.org> X-Virus-Checked: Checked by ClamAV on apache.org Author: phunt Date: Fri Oct 3 16:22:21 2008 New Revision: 701566 URL: http://svn.apache.org/viewvc?rev=701566&view=rev Log: ZOOKEEPER-154. reliability graph diagram in overview doc needs context & ZOOKEEPER-155. improve the zookeeper project section of overview doc Modified: hadoop/zookeeper/trunk/CHANGES.txt hadoop/zookeeper/trunk/src/docs/src/documentation/content/xdocs/zookeeperOver.xml Modified: hadoop/zookeeper/trunk/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/zookeeper/trunk/CHANGES.txt?rev=701566&r1=701565&r2=701566&view=diff ============================================================================== --- hadoop/zookeeper/trunk/CHANGES.txt (original) +++ hadoop/zookeeper/trunk/CHANGES.txt Fri Oct 3 16:22:21 2008 @@ -17,6 +17,12 @@ BUGFIXES: + ZOOKEEPER-154. reliability graph diagram in overview doc needs context + (phunt) + + ZOOKEEPER-155. improve "the zookeeper project" section of overview doc + (phunt) + ZOOKEEPER-147. This is version of the documents with most of the [tbd...] scrubbed out (robbie via phunt) Modified: hadoop/zookeeper/trunk/src/docs/src/documentation/content/xdocs/zookeeperOver.xml URL: http://svn.apache.org/viewvc/hadoop/zookeeper/trunk/src/docs/src/documentation/content/xdocs/zookeeperOver.xml?rev=701566&r1=701565&r2=701566&view=diff ============================================================================== --- hadoop/zookeeper/trunk/src/docs/src/documentation/content/xdocs/zookeeperOver.xml (original) +++ hadoop/zookeeper/trunk/src/docs/src/documentation/content/xdocs/zookeeperOver.xml Fri Oct 3 16:22:21 2008 @@ -387,16 +387,28 @@ Failure of another leader + -
- Reliability in the Presence of Errors +
+ Reliability + To show the behavior of the system over time as + failures are injected we ran a ZooKeeper service made up of + 7 machines. We ran the same saturation benchmark as before, + but this time we kept the write percentage at a constant + 30%, which is a conservative ratio of our expected + workloads. + + +
+ Reliability in the Presence of Errors -
+
+
The are a few important observations from this graph. First, if followers fail and recover quickly, then ZooKeeper is able to sustain a @@ -411,25 +423,27 @@
The ZooKeeper Project - ZooKeeper has been successfully used in industrial applications. - It is used at Yahoo! as the coordination and failure recovery service - for Yahoo! Message Broker, which is a highly scalable publish-subscribe - system managing thousands of topics for replication and data delivery. - It is used by the Fetching Service for Yahoo! crawler, where it also - manages failure recovery. And it is used by Hadoop On Demand (HOD), - which is an open source implementation of the map-reduce model of - computation. HOD uses Zookeeper as a communications and control channel - between slave and master process. (For more information, see the Hadoop and Hadoop on - Demand open source projects on Apache.) - - ZooKeeper itself is an open source project, under the Apache Open - Source Foundation. It is a subproject of Hadoop. All users and - developers are encourged to join the community and contribute their - expertise. See the Zookeeper Project on - Apache for more information. + ZooKeeper has been + + successfully used + + in many industrial applications. It is used at Yahoo! as the + coordination and failure recovery service for Yahoo! Message + Broker, which is a highly scalable publish-subscribe system + managing thousands of topics for replication and data + delivery. It is used by the Fetching Service for Yahoo! + crawler, where it also manages failure recovery. A number of + Yahoo! advertising systems also use ZooKeeper to implement + reliable services. + + + All users and developers are encouraged to join the + community and contribute their expertise. See the + + Zookeeper Project on Apache + + for more information. +