Mailing-List: contact zookeeper-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: zookeeper-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of milindparikh@gmail.com
 designates 209.85.160.48 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=q8zbPrQ6l36DR8QKKAc5gvQZaFIf9FqZi5wFp5LZyLb8Vtu1zEoWSkwJS9e7onYhpV
         TUMrTJiNyWb+g9v5NvV0dUEY5dXwXR0HGsKmKY0ywAhpmA3fOm5Efmv+O1M3e0bYqmaX
         G8eBIgw3VUtqegXQWS3y81F1HIa1CqWxiENs8=
MIME-Version: 1.0
In-Reply-To: <AANLkTi=eZ7xD_n5npOs3+Rw7hD+TX7v=46y6c8GnVq3e@mail.gmail.com>
References: <AANLkTi=eZ7xD_n5npOs3+Rw7hD+TX7v=46y6c8GnVq3e@mail.gmail.com>
Date: Fri, 8 Oct 2010 08:18:20 -0700
Message-ID: <AANLkTik-qsA4ULOrSuTQD6CAtVr0y0Q69CmzCiOb9t0u@mail.gmail.com>
Subject: Re: is zookeeper suitable for my application?
From: Milind Parikh <milindparikh@gmail.com>
To: zookeeper-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=00163646c25a620a4204921c85b1

--00163646c25a620a4204921c85b1
Content-Type: text/plain; charset=ISO-8859-1

There are existing recipes that you will be able to modify for your needs.
Ymmv but look at the double barrier recipe. The key thing to design around
in high. Scalability based solution is the herding effect.
Perhaps look @ couchdb to store your files for znode?
Regards
Milind

On Oct 8, 2010 3:31 AM, "Li Li" <fancyerii@gmail.com> wrote:

hi all,
   I am a newbie of zookeeper and want to know whether zookeeper is
suitable for my application. If it does, then I will try to learn more
about it.
   My problem can be described as a producer-consumer problem.
   There is a thread that continue producing data files untill the
queue is full and then waiting consumer. Consumers can be divided into
2 categories -- Master and Slave. The data can not be removed from
queue unless it's consumed by master. The data will be removed
immediately if it consumed by all the consumers. But if the queue is
full, it will remove data that are consumed by Master. There will be
only one Master and many Slaves. The count of Slaves will change(it
seems zookeeper provide Ephemeral ZNode).
   it seems that znode's size should less than 1 mb. but I will need
save large data file in a znode. Is there any solution for this?
   thank you.

--00163646c25a620a4204921c85b1--