Return-Path: Delivered-To: apmail-hadoop-zookeeper-user-archive@minotaur.apache.org Received: (qmail 9408 invoked from network); 8 Oct 2010 10:31:37 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 8 Oct 2010 10:31:37 -0000 Received: (qmail 45511 invoked by uid 500); 8 Oct 2010 10:31:36 -0000 Delivered-To: apmail-hadoop-zookeeper-user-archive@hadoop.apache.org Received: (qmail 45432 invoked by uid 500); 8 Oct 2010 10:31:34 -0000 Mailing-List: contact zookeeper-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: zookeeper-user@hadoop.apache.org Delivered-To: mailing list zookeeper-user@hadoop.apache.org Received: (qmail 45423 invoked by uid 99); 8 Oct 2010 10:31:33 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 08 Oct 2010 10:31:33 +0000 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of fancyerii@gmail.com designates 74.125.82.48 as permitted sender) Received: from [74.125.82.48] (HELO mail-ww0-f48.google.com) (74.125.82.48) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 08 Oct 2010 10:31:26 +0000 Received: by wwb34 with SMTP id 34so877443wwb.29 for ; Fri, 08 Oct 2010 03:31:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:date:message-id :subject:from:to:content-type; bh=KogDSkUPNPfrJOzPbocbu/p0VH0DhBAb0UDZunupvJ4=; b=LAb2y0RjGxh4f2SFSsXR0nbMMP+sY51LNGv2ey+8LrS+q9/iXMpmEcPpYsc6qa7+gL CPVwSIleNz6c7EztYq0O8dNHMtAA9pnsxYr7ihwe51skZDvN20Uw/+zQ3BNUijM9ULy1 bVPYTuUwERhu5iRCFZs3XZjMSw+0o4HvYb/bk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=G4xUQy9+8VDzSZXfKfxD1z0yi6THgjmApITPEhjpyJlALPMN8QTxqwTHyDiNe/CD+6 G6SnGRz/HNDClNSlIk2UUnHfeeBRCkfzRyF2pd+CxCMKDgY2ABxWYm/Hz8P8wltEtFcb lY0g9qbLImUpc3vhd6OYis6tIZUXh9hVlb6K0= MIME-Version: 1.0 Received: by 10.216.19.13 with SMTP id m13mr1989921wem.101.1286533865810; Fri, 08 Oct 2010 03:31:05 -0700 (PDT) Received: by 10.216.35.68 with HTTP; Fri, 8 Oct 2010 03:31:05 -0700 (PDT) Date: Fri, 8 Oct 2010 18:31:05 +0800 Message-ID: Subject: is zookeeper suitable for my application? From: Li Li To: zookeeper-user@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org hi all, I am a newbie of zookeeper and want to know whether zookeeper is suitable for my application. If it does, then I will try to learn more about it. My problem can be described as a producer-consumer problem. There is a thread that continue producing data files untill the queue is full and then waiting consumer. Consumers can be divided into 2 categories -- Master and Slave. The data can not be removed from queue unless it's consumed by master. The data will be removed immediately if it consumed by all the consumers. But if the queue is full, it will remove data that are consumed by Master. There will be only one Master and many Slaves. The count of Slaves will change(it seems zookeeper provide Ephemeral ZNode). it seems that znode's size should less than 1 mb. but I will need save large data file in a znode. Is there any solution for this? thank you.