Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BCEB3628F for ; Fri, 3 Jun 2011 11:47:43 +0000 (UTC) Received: (qmail 66369 invoked by uid 500); 3 Jun 2011 11:47:40 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 66325 invoked by uid 500); 3 Jun 2011 11:47:40 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 66317 invoked by uid 99); 3 Jun 2011 11:47:40 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Jun 2011 11:47:40 +0000 X-ASF-Spam-Status: No, hits=0.7 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [98.139.52.201] (HELO nm4.bullet.mail.ac4.yahoo.com) (98.139.52.201) by apache.org (qpsmtpd/0.29) with SMTP; Fri, 03 Jun 2011 11:47:31 +0000 Received: from [98.139.52.188] by nm4.bullet.mail.ac4.yahoo.com with NNFMP; 03 Jun 2011 11:47:10 -0000 Received: from [98.139.52.146] by tm1.bullet.mail.ac4.yahoo.com with NNFMP; 03 Jun 2011 11:47:10 -0000 Received: from [127.0.0.1] by omp1029.mail.ac4.yahoo.com with NNFMP; 03 Jun 2011 11:47:10 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 470802.97949.bm@omp1029.mail.ac4.yahoo.com Received: (qmail 45053 invoked by uid 60001); 3 Jun 2011 11:47:10 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1307101630; bh=z20Xxyb8WSanQZOxnoqC45dUK/q6/JvBi8pe/fSzF2E=; h=Message-ID:X-YMail-OSG:Received:X-RocketYMMF:X-Mailer:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=ItM9cyRPmC3YmUzjNMeQUAL6lYrLYKgXuXdPlU01+FCkxUtgcaAQ2LodPp9NgB93j31mfPN3id6Phx4hakrfHvNgNKbqI6ZBVtZUKyd67oMNY9R7xmmcMsyRZt4elF5yGY8tApqXfJ8rTnbI/txPvIUShliGvMwyCh5yekn807A= Message-ID: <216725.44261.qm@web65508.mail.ac4.yahoo.com> X-YMail-OSG: l4fuQGgVM1n_422vfWbu9tdLCYf1oiPXfaq9CVgjDqVS9BZ _jJrC.qib75qoDvJ_uwbD623.zndqa4PEwfkoyjkalzUiwn9XvM3Q_HBngd2 2FBy1GY5UZV4P8Y8O_pFIgUw.n239BKsA2g6zz.2qir78HrgJ7UbxvzACs6R 94K102s4Dbtqg_jWzcedQJ.IXl0..Vx3BsngqcXu4.RU3xYaxlfN2dUWl_E3 cijtBaXgaG3gdAwlFHDtFLiKoHMTfZAtiH.lg23Eu7JYLj2DRZuv5e1bFwGn Bg2mLPkstOWT_LrmPGGJ2cW7oLnaW0RoyxAHRaFUUyWrSbVfFGa0JGBBo_kG 2z_pA2NSHbTy8Ng3jbXtd_v.DRolyFHi7tqIeqTEW_KKp7u8.g4XTMW4y44x YYsSaxhkfHf8T Received: from [213.61.227.42] by web65508.mail.ac4.yahoo.com via HTTP; Fri, 03 Jun 2011 04:47:10 PDT X-RocketYMMF: apurtell X-Mailer: YahooMailClassic/14.0.1 YahooMailWebService/0.8.111.303096 Date: Fri, 3 Jun 2011 04:47:10 -0700 (PDT) From: Andrew Purtell Reply-To: apurtell@apache.org Subject: Re: Does Hadoop 0.20.2 and HBase 0.90.3 compatible ?? To: common-user@hadoop.apache.org, user@hbase.apache.org In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable > Is *Hadoop 0.20.2=A0 also not compatible with Hbase 0.90.3 ???*=0A=0AIn a= strict sense they are, but without append support HBase cannot guarantee t= hat the last block of write ahead logs are synced to disk, so in some failu= re cases edits will be lost. With append support then the "hole" of these f= ailure cases is closed. Also append branch adds a change to lease recovery = that allows the HBase Master to take ownership of regionserver logs in orde= r to split them quickly. (Without this patch you may be waiting 10 minutes = for lease recovery...) So these differences are clearly important for durab= ility and fault recovery in a realistic time frame.=0A=0AA full reinstallat= ion is not necessary.=0A=0AYou can take the Hadoop core jar packaged in lib= / of HBase 0.90.3 and replace every Hadoop core jar on your cluster with th= em.=0A=0AOR =0A=0AYou can compile 0.20-append and just replace the Hadoop c= ore jar everywhere with the result, including the one in the HBase lib/.=0A= =0A - Andy=0A=0A--- On Fri, 6/3/11, praveenesh kumar wrote:=0A=0A> From: praveenesh kumar =0A> Subject:= Does Hadoop 0.20.2 and HBase 0.90.3 compatible ??=0A> To: common-user@hado= op.apache.org, user@hbase.apache.org=0A> Date: Friday, June 3, 2011, 3:37 A= M=0A> Guys,=0A> =0A> I am in a very big big confusion. Please.. I really ne= ed=0A> your feedbacks and=0A> suggestions..=0A> =0A> The scenario is like t= his...=0A> =0A> I set up *Hadoop 0.20.2 cluster* of *12 nodes*..=0A> =0A> N= ow I set up* Hbase 0.90.3*=A0 *12 node cluster* on top=0A> of it.=0A> =0A> = But after all that experimenting and struggling.. I read=0A> the following = SHOCKING line on my Hbase web UI=0A> =0A> ---* " You are currently running = the HMaster without HDFS append support=0A> enabled. This may result in dat= a loss. Please see the HBase wiki for=0A> details. "*=0A> =0A> And when I s= earched more about it.. I found Michael G. Nolls article..=0A> saying that = *Hadoop 0.20.2 and Hbase 0.90.2 are not compatible*.=0A> =0A> Is *Hadoop 0.= 20.2=A0 also not compatible with Hbase 0.90.3 ???*=0A> =0A> So does=A0 it m= eans I have to re-install hadoop 0.20.=0A> append if I want to use Hbase.= =0A> =0A> I did a lot of struggle to reach upto this stage.. do I=0A> have = to do all of it again.. ??=0A> =0A> Is there any other work around solution= .. of not=0A> re-installing everything again ??=0A> =0A> Please help..!!!= =A0 :-(=0A> =0A> Thanks,=0A> Praveenesh=0A>