Return-Path: Delivered-To: apmail-hadoop-zookeeper-user-archive@minotaur.apache.org Received: (qmail 30972 invoked from network); 2 Oct 2010 07:39:28 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 2 Oct 2010 07:39:28 -0000 Received: (qmail 63901 invoked by uid 500); 2 Oct 2010 07:39:28 -0000 Delivered-To: apmail-hadoop-zookeeper-user-archive@hadoop.apache.org Received: (qmail 63782 invoked by uid 500); 2 Oct 2010 07:39:25 -0000 Mailing-List: contact zookeeper-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: zookeeper-user@hadoop.apache.org Delivered-To: mailing list zookeeper-user@hadoop.apache.org Received: (qmail 63774 invoked by uid 99); 2 Oct 2010 07:39:24 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 02 Oct 2010 07:39:24 +0000 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [68.142.207.66] (HELO web31803.mail.mud.yahoo.com) (68.142.207.66) by apache.org (qpsmtpd/0.29) with SMTP; Sat, 02 Oct 2010 07:39:17 +0000 Received: (qmail 53853 invoked by uid 60001); 2 Oct 2010 07:38:54 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1286005134; bh=ojJXGU1AOG6BdzBj4hlo2YuSq/cuxsZTVbosU8DbDDY=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:References:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=SvK0kxFah0DHv2zkEjdQauWNFjwaamGt6Crnrv+m1tHKSb4gzOOFxuLg6zST57ZgNzSPPQxIHquLgeEh5vCobLGRAkPKEl6jBPxW26SJgweEUszKji5xBc1rATtgYg6uRarZxjJAJlt2fgJvx+uyEs9GGri954CQ9vppNuhKAqs= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:References:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=Vv+16g/oAtKvwpL6VDTqgWHa9ewRjfV0iVPurKZrGlWDjqTxn5oXnMArIhmltt58v6njkh6vCCmAsuhF+RMlPNLlk8OtFU/CV0rIPxWAvhZz7nDO6CREM0/RYx1DBa2SB9cdOTGBX2WSptoVYigmgHKKinswxjsTOwMhe7NmxSE=; Message-ID: <663279.53850.qm@web31803.mail.mud.yahoo.com> X-YMail-OSG: PGCsMZwVM1mQxRcOK4YPaN_YnYRJ4bqTc9UKsmT4ud6a4ul wBSXcdhi5sxJW69ImVBSLUM5sVo1WAdQ8POypMg_EaiRWzj1KyGebiQUiQ0U SWzKwZZTHxLWJWJkDlvA44hDRqzFuEfmEomzabJ6zRUhNypggsOBC4b15pP4 rYitbMFMz_nkcw.FPgEw3meKX1R8omqxp2UzzYPIJKySKRwpzO_40H_WeKIT gaTXc6Sd1Ki.M9T6_T7_Dcqru_oO9LWanmHMQ.y_uuoTt09uFsvk90E7balV LUlZy2CgRI0eOieDHuEM5dTuG5mCgbaIzk7fRwMfj4B66Vg.9XhvuZxGszn3 fmDDzA40Vy2hHHZAL4qavPzun0KqW Received: from [117.192.7.173] by web31803.mail.mud.yahoo.com via HTTP; Sat, 02 Oct 2010 00:38:54 PDT X-Mailer: YahooMailRC/497 YahooMailWebService/0.8.107.284920 References: <853734.74273.qm@web31801.mail.mud.yahoo.com> Date: Sat, 2 Oct 2010 00:38:54 -0700 (PDT) From: amit jaiswal Subject: Re: BookKeeper newbie question To: zookeeper-user@hadoop.apache.org In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Hi Flavio,=0A=0AI am using zookeeper 3.2.2. The documentation on apache =0A= (http://hadoop.apache.org/zookeeper/docs/r3.3.0/bookkeeperStarted.html) ref= ers =0Ato example that uses LedgerSequence class.=0A=0A=0ABasically I am tr= ying to use BookKeeper / Hedwig and see if they can be used as =0Aa reliabl= e message bus. Hedwig has only a video (http://vimeo.com/13282102) that =0A= explains the system overview. But installation is non-trivial. I tried buil= ding =0Afrom trunk, but trunk version is 3.4 and hedwig bundles zk 3.2 code= within =0Aitself. In short, was not able to build/install hedwig.=0A=0A1. = Could you please give some pointers for hedwig. It seems that BookKeeper AP= Is =0Aneed higher level abstraction which Hedwig can provide.=0A=0A2. How d= oes bookkeeper handles zk session expiry? To be honest, zk itself should = =0Acome up with a solution to recover from session expiry. Found this blog = =0A: http://sna-projects.com/blog/2010/08/zookeeper-experience/ which actua= lly =0Alists all the issues that I also faced while working with zk. =0A=0A= 3. Any comments on '=E2=80=9CLow Latency Message Bus With Scribe and HDFS= =0A : http://sna-projects.com/blog/2010/09/scribe-and-hdfs/ and how that co= mpares =0Ato BookKeeper / Hedwig?=0A=0A-regards=0AAmit=0A=0A=0A=0A=0A----- = Original Message ----=0AFrom: Flavio Junqueira =0ATo: "z= ookeeper-user@hadoop.apache.org" =0ASent:= Fri, 1 October, 2010 2:37:35 PM=0ASubject: Re: BookKeeper newbie question= =0A=0AThanks for your questions, Amit.=0A=0AOn Sep 28, 2010, at 6:37 PM, am= it jaiswal wrote:=0A=0A> Hi,=0A> =0A> I am experimenting with BookKeeper an= d have a question on LedgerHandler class.=0A> The readEntries(firstEntry, l= astEntry) method takes the indexes of first and=0A> last entries. Also, the= LedgerSequence object returned has method=0A> hasMoreElements().=0A=0AWhic= h version are you using? I don't think we have LedgerSequence any longer.= =0A=0A> =0A> Question:=0A> 1. How does a client knows the index of the last= entry? I was expecting =0Aclients=0A> to make a call like readEntries(0, I= nteger.MAX_INT) and the hasMoreElements() =0A>to=0A> return false the momen= t there are no more entries. Am I missing something in =0A>the=0A> way the = API is supposed to be used?=0A> =0A=0AI believe you should use public long = getLastAddConfirmed().=0A=0A=0A> 2. The LedgerSequence.hasMoreElements() re= turns true (even if there are no =0Amore=0A> entries), and the nextEntry re= turns null.=0A> =0A=0AreadEntries currently return Enumeration= , but I just noticed that =0Athe documentation is not correct, so I'll open= a jira to fix it.=0A=0A-Flavio