Return-Path: X-Original-To: apmail-zookeeper-bookkeeper-user-archive@minotaur.apache.org Delivered-To: apmail-zookeeper-bookkeeper-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 833B0E486 for ; Wed, 6 Feb 2013 06:29:25 +0000 (UTC) Received: (qmail 73355 invoked by uid 500); 6 Feb 2013 06:29:25 -0000 Delivered-To: apmail-zookeeper-bookkeeper-user-archive@zookeeper.apache.org Received: (qmail 73327 invoked by uid 500); 6 Feb 2013 06:29:24 -0000 Mailing-List: contact bookkeeper-user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: bookkeeper-user@zookeeper.apache.org Delivered-To: mailing list bookkeeper-user@zookeeper.apache.org Received: (qmail 73301 invoked by uid 99); 6 Feb 2013 06:29:24 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Feb 2013 06:29:24 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [216.32.180.30] (HELO va3outboundpool.messaging.microsoft.com) (216.32.180.30) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Feb 2013 06:29:14 +0000 Received: from mail240-va3-R.bigfish.com (10.7.14.243) by VA3EHSOBE001.bigfish.com (10.7.40.21) with Microsoft SMTP Server id 14.1.225.23; Wed, 6 Feb 2013 06:28:52 +0000 Received: from mail240-va3 (localhost [127.0.0.1]) by mail240-va3-R.bigfish.com (Postfix) with ESMTP id 0C195B00098 for ; Wed, 6 Feb 2013 06:28:52 +0000 (UTC) X-Forefront-Antispam-Report: CIP:157.56.232.5;KIP:(null);UIP:(null);IPV:NLI;H:BLUPRD0711HT003.namprd07.prod.outlook.com;RD:none;EFVD:NLI X-SpamScore: -7 X-BigFish: PS-7(zz9371Ic85fh14e3M4015Izz1ee6h1de0h1202h1e76h1d1ah1d2ahzz18de19h17326ah8275bh8275dh18c673hz2dh2a8h668h839hd25hf0ah1288h12a5h12bdh137ah1441h1504h1537h153bh15d0h162dh1631h1758h18e1h1946h19b5h1155h) Received: from mail240-va3 (localhost.localdomain [127.0.0.1]) by mail240-va3 (MessageSwitch) id 1360132129843712_32652; Wed, 6 Feb 2013 06:28:49 +0000 (UTC) Received: from VA3EHSMHS015.bigfish.com (unknown [10.7.14.250]) by mail240-va3.bigfish.com (Postfix) with ESMTP id C14D03A004A for ; Wed, 6 Feb 2013 06:28:49 +0000 (UTC) Received: from BLUPRD0711HT003.namprd07.prod.outlook.com (157.56.232.5) by VA3EHSMHS015.bigfish.com (10.7.99.25) with Microsoft SMTP Server (TLS) id 14.1.225.23; Wed, 6 Feb 2013 06:28:49 +0000 Received: from BLUPRD0711MB425.namprd07.prod.outlook.com ([169.254.5.90]) by BLUPRD0711HT003.namprd07.prod.outlook.com ([10.255.120.38]) with mapi id 14.16.0263.000; Wed, 6 Feb 2013 06:28:48 +0000 From: Savitha Devi Inbasekaran To: "bookkeeper-user@zookeeper.apache.org" Subject: RE: Integrating namenode with bookkeeper Thread-Topic: Integrating namenode with bookkeeper Thread-Index: Ac397PKthnGEIuJITTai/BoaFiXtmAAC0OxoADlPPtAAApz7ogFSfamw Date: Wed, 6 Feb 2013 06:28:47 +0000 Message-ID: <3FB7201434374943BB352B31A7E6AFB344341C42@BLUPRD0711MB425.namprd07.prod.outlook.com> References: <3FB7201434374943BB352B31A7E6AFB34433C0BF@BLUPRD0711MB425.namprd07.prod.outlook.com> <1542FA4EE20C5048A5C2A3663BED2A6B30B6D1BD@szxeml531-mbx.china.huawei.com>,<3FB7201434374943BB352B31A7E6AFB34433C17B@BLUPRD0711MB425.namprd07.prod.outlook.com> <1542FA4EE20C5048A5C2A3663BED2A6B30B6DF2F@szxeml531-mbx.china.huawei.com> In-Reply-To: <1542FA4EE20C5048A5C2A3663BED2A6B30B6DF2F@szxeml531-mbx.china.huawei.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [115.160.224.66] Content-Type: multipart/alternative; boundary="_000_3FB7201434374943BB352B31A7E6AFB344341C42BLUPRD0711MB425_" MIME-Version: 1.0 X-OriginatorOrg: smartek21.com X-Virus-Checked: Checked by ClamAV on apache.org --_000_3FB7201434374943BB352B31A7E6AFB344341C42BLUPRD0711MB425_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Thanks Uma. I was able generate all the necessary jar files. But when I for= mat the hdfs namenode I got the following error. bin/hdfs: line 162: exec: : not found Thanks, Savitha From: Uma Maheswara Rao G [mailto:maheswara@huawei.com] Sent: Wednesday, January 30, 2013 6:24 PM To: bookkeeper-user@zookeeper.apache.org Cc: Ivan Kelly Subject: RE: Integrating namenode with bookkeeper I am not sure which commens you executed for building. See the section in that document: =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D Building BookKeeper Journal Manager plugin jar To generate the distribution packages for BK journal, do the following. $ mvn clean package -Pdist This will generate a jar with the BookKeeperJournalManager, all the depende= ncies needed by the journal manager, hadoop-hdfs-project/hadoop-hdfs/src/co= ntrib/bkjournal/target/hadoop-hdfs-bkjournal-VERSION.jar =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D After downloading Hadoop code with svn checkout, go to folder hadoop-hdfs-p= roject/hadoop-hdfs/src/contrib/bkjournal execute the folowing command: mvn clean install -DskipTests this will clean everything and generate the jars cleanly for you. I gave -D= skipTests option to just skipping test cases running(that will take time if= you run). After this go to hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/targ= et folder. Here you can see the jar file. Please note that: I hope you have maven installed and protocol buffers also= installed. If not please install them first. They needed while building. >From above trace, looks like you are executing some ant commands? BKJM buil= d supports maven. please try with the above suggested commands. ________________________________ From: Savitha Devi Inbasekaran [Savithadi@smartek21.com] Sent: Wednesday, January 30, 2013 5:06 PM To: bookkeeper-user@zookeeper.apache.org Cc: Ivan Kelly Subject: RE: Integrating namenode with bookkeeper Hi uma, I followed the steps in the documentation to generate bkjournal jar files b= ut I got struck again and following is the error. [ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin= :1.6:run (create-testdirs) on project hadoop-hdfs: Error executing ant task= s: /hadoop-common/hadoop-hdfs-project/hadoop-hdfs/target/antrun/build-main.= xml (No such file or directory) Thanks, Savitha From: Uma Maheswara Rao G [mailto:maheswara@huawei.com] Sent: Tuesday, January 29, 2013 1:47 PM To: bookkeeper-user@zookeeper.apache.org Cc: Ivan Kelly Subject: FW: Integrating namenode with bookkeeper Hi Savitha, It is already available with Hadoop-2.x releases Please try the latest release Hadoop 2.0.2 release. Take a look at the integration releated documentation here. (section BookKe= eper_as_a_Shared_storage at the end) http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/HDFSHigh= Availability.html This will give you the info that how you can generate the hadoop-hdfs-bkjou= rnal jar files and place in lib folder of HDFS. Here is the Hadoop release site: http://hadoop.apache.org/releases.html#9+O= ctober%2C+2012%3A+Release+2.0.2-alpha+available Regards, Uma ________________________________ From: Savitha Devi Inbasekaran [Savithadi@smartek21.com] Sent: Tuesday, January 29, 2013 12:30 PM To: Ivan Kelly Cc: bookkeeper-user@zookeeper.apache.org Subject: Integrating namenode with bookkeeper Hi Ivan, I want to integrate namenode with bookkeeper. I followed the steps which yo= u specified in the link http://mail-archives.apache.org/mod_mbox/zookeeper-= bookkeeper-user/201203.mbox/browser . While setting up Bookkeeper Journal Manager I got struck up. The trunk whic= h I downloaded from github doesn't have hadoop-common-SNAPSHOT, hadoop-hdfs= -SNAPSHOT and hadoop-hdfs-bkjournal-0.24.0-SNAPSHOT.jar. Please help me. Thanks, Savitha --_000_3FB7201434374943BB352B31A7E6AFB344341C42BLUPRD0711MB425_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Thanks Uma. I was able= generate all the necessary jar files. But when I format the hdfs namenode = I got the following error.

 

bin/hdfs: line 1= 62: exec: : not found

 

Thanks,

Savitha

From: Uma Mahe= swara Rao G [mailto:maheswara@huawei.com]
Sent: Wednesday, January 30, 2013 6:24 PM
To: bookkeeper-user@zookeeper.apache.org
Cc: Ivan Kelly
Subject: RE: Integrating namenode with bookkeeper<= /p>

 

 

I am not sure which commens you executed for bui= lding.

 

See the section in that document:

=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D

Building BookKeeper Journal Manager plug= in jar

To generate the distribution packages for BK jou= rnal, do the following.

$ mvn clean package -Pdist

This will generate a jar with the BookKeeperJour= nalManager, all the dependencies needed by the journal manager, hadoop-hdfs= -project/hadoop-hdfs/src/contrib/bkjournal/target/hadoop-hdfs-bkjournal-= VERSION.jar

=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D

 =

After downloading Hadoop= code with svn checkout, go to folder hadoop-hdfs-project/hadoop-hdfs/src/c= ontrib/bkjournal

execute the folowing com= mand:

mvn clean install -Dskip= Tests

 =

this will clean everythi= ng and generate the jars cleanly for you. I gave -DskipTests option to just= skipping test cases running(that will take time if you run).

 =

After this go to hadoop-= hdfs-project/hadoop-hdfs/src/contrib/bkjournal/target folder. Here you can = see the jar file.

 =

Please note that: I hope= you have maven installed and protocol buffers also installed. If not pleas= e install them first. They needed while building.

 =

From above trace, looks = like you are executing some ant commands? BKJM build supports maven. please= try with the above suggested commands.

 =

From: Savitha Devi Inbasekaran [Sa= vithadi@smartek21.com]
Sent: Wednesday, January 30, 2013 5:06 PM
To: bookkeep= er-user@zookeeper.apache.org
Cc: Ivan Kelly
Subject: RE: Integrating namenode with bookkeeper

Hi uma,

I followed the steps i= n the documentation to generate bkjournal jar files but I got struck again = and following is the error.

[ERROR] Failed to exec= ute goal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (create-testd= irs) on project hadoop-hdfs: Error executing ant tasks: /hadoop-common/hado= op-hdfs-project/hadoop-hdfs/target/antrun/build-main.xml (No such file or directory)<= /span>

 =

Thanks,

Savitha

 =

From: Uma Maheswara Rao G [mailto:maheswara@huawei.com]
Sent: Tuesday, January 29, 2013 1:47 PM
To: bookkeep= er-user@zookeeper.apache.org
Cc: Ivan Kelly
Subject: FW: Integrating namenode with bookkeeper

 =

Hi Savitha,

 

It is already available with Hadoop-2.x releases=

 

Please try the latest release Hadoop 2.0.2 relea= se.

 

Take a look at the integration releated document= ation here. (section BookKeeper_as_a_Shared_storage<= span style=3D"font-size:10.0pt;font-family:"Tahoma","sans-se= rif";color:blue"> at the end)

= http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/HDFSHigh= Availability.html<= /p>

This will give you the info that how you can gen= erate the hadoop-hdfs-bkjournal jar files and place in lib folder of HDFS.<= /span>

 

Here is the Hadoop release site: http://hadoop.apache.org/releases.html#9+October%2C+2012%3A+Rel= ease+2.0.2-alpha+available

 

Regards,=

Uma

From: Savitha Devi Inbasekaran [Sa= vithadi@smartek21.com]
Sent: Tuesday, January 29, 2013 12:30 PM
To: Ivan Kelly
Cc: bookkeeper-user@zookeeper.apache.org
Subject: Integrating namenode with bookkeeper

 =

Hi Ivan,

I want to integrate name= node with bookkeeper. I followed the steps which you specified in the link http://mail-archives.apache.org/mod_mbox/zookeeper-bookkeeper-user/201203.m= box/browser .

While setting up Bookkee= per Journal Manager I got struck up. The trunk which I downloaded from gith= ub doesn’t have hadoop-common-SNAPSHOT, hadoop-hdfs-SNAPSHOT and=

hadoop-hdfs-bkjournal-0.= 24.0-SNAPSHOT.jar. Please help me.

 =

Thanks,

Savitha

 =

--_000_3FB7201434374943BB352B31A7E6AFB344341C42BLUPRD0711MB425_--