Return-Path: X-Original-To: apmail-zookeeper-user-archive@www.apache.org Delivered-To: apmail-zookeeper-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3A0C99B98 for ; Mon, 5 Mar 2012 14:30:53 +0000 (UTC) Received: (qmail 20579 invoked by uid 500); 5 Mar 2012 14:30:52 -0000 Delivered-To: apmail-zookeeper-user-archive@zookeeper.apache.org Received: (qmail 20545 invoked by uid 500); 5 Mar 2012 14:30:52 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Received: (qmail 20535 invoked by uid 99); 5 Mar 2012 14:30:52 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 05 Mar 2012 14:30:52 +0000 X-ASF-Spam-Status: No, hits=-0.1 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of cf@renttherunway.com designates 74.125.245.96 as permitted sender) Received: from [74.125.245.96] (HELO na3sys010aog114.obsmtp.com) (74.125.245.96) by apache.org (qpsmtpd/0.29) with SMTP; Mon, 05 Mar 2012 14:30:45 +0000 Received: from mail-we0-f177.google.com ([74.125.82.177]) (using TLSv1) by na3sys010aob114.postini.com ([74.125.244.12]) with SMTP ID DSNKT1TN/5e/LD3+d79klR21Zg6fouO8qmFP@postini.com; Mon, 05 Mar 2012 06:30:24 PST Received: by mail-we0-f177.google.com with SMTP id p11so3359850wer.8 for ; Mon, 05 Mar 2012 06:30:22 -0800 (PST) Received-SPF: pass (google.com: domain of cf@renttherunway.com designates 10.180.99.100 as permitted sender) client-ip=10.180.99.100; Authentication-Results: mr.google.com; spf=pass (google.com: domain of cf@renttherunway.com designates 10.180.99.100 as permitted sender) smtp.mail=cf@renttherunway.com Received: from mr.google.com ([10.180.99.100]) by 10.180.99.100 with SMTP id ep4mr15667175wib.7.1330957822970 (num_hops = 1); Mon, 05 Mar 2012 06:30:22 -0800 (PST) MIME-Version: 1.0 Received: by 10.180.99.100 with SMTP id ep4mr12476877wib.7.1330957822910; Mon, 05 Mar 2012 06:30:22 -0800 (PST) Sender: cf@renttherunway.com Received: by 10.216.164.84 with HTTP; Mon, 5 Mar 2012 06:30:22 -0800 (PST) In-Reply-To: <4F54AA77.40905@team345.com> References: <4F54AA77.40905@team345.com> Date: Mon, 5 Mar 2012 09:30:22 -0500 X-Google-Sender-Auth: G0eZyJmzs6DryLjR2pJF9dt6IAM Message-ID: Subject: Re: Newbie design question From: Camille Fournier To: user@zookeeper.apache.org Content-Type: multipart/alternative; boundary=f46d04428e5c3ee1dd04ba7fc408 X-Gm-Message-State: ALoCoQmJup6tgpf1SFmA65thcX7qNbo6mi4gm3fi8DHbCVzxn51DSbOMceJ9/S2I8gM/sP9bHM7R X-Virus-Checked: Checked by ClamAV on apache.org --f46d04428e5c3ee1dd04ba7fc408 Content-Type: text/plain; charset=ISO-8859-1 Run an ensemble of ZK machines. Each job node just needs to use a zookeeper client library to pull jobs down. You do not want to run a large ensemble of ZK nodes unless absolutely necessary. The more machines in a ZK ensemble, the slower writes are able to be processed. The only reason for going larger than 3 is really to enable many more concurrent client connections (on the order of tens of thousands). Sounds like you are not in that situation, so a 3 node ensemble is probably best for you. C On Mon, Mar 5, 2012 at 6:58 AM, Joe Gamache wrote: > Hello folks, > > I skimmed the archives, but couldn't find a way to search them, does that > exist? > > So I am new to zookeeper and was hoping to get some early guidance. The > first little part of what I need to implement is fairly straight-forward. > I have a list of requests. Each request needs to be issued out to a > different machine and monitored. Ok, it's very straight-forward! :) > There are no dependencies between these jobs. There is to another set of > jobs, but I don't have to deal with that for this first step. There will > probably be on the order of fifty machines. Looking over the > documentation and examples, it seems like I can just use a Queue, Executor, > and Monitor.... > > My question is do I need/want zookeeper on all of the nodes or just 3,5, > or 7 (as an ensemble)? Is there a known tradeoff between the two > approaches - all nodes or small subset? > > Sorry if this or similar questions have already been asked, but thanks for > any pointers. > > Joe > > --f46d04428e5c3ee1dd04ba7fc408--