Return-Path: Delivered-To: apmail-hive-user-archive@www.apache.org Received: (qmail 52206 invoked from network); 12 Jan 2011 07:06:21 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 12 Jan 2011 07:06:21 -0000 Received: (qmail 43533 invoked by uid 500); 12 Jan 2011 07:06:20 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 43444 invoked by uid 500); 12 Jan 2011 07:06:17 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 43436 invoked by uid 99); 12 Jan 2011 07:06:16 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 12 Jan 2011 07:06:16 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [207.97.245.201] (HELO smtp201.iad.emailsrvr.com) (207.97.245.201) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 12 Jan 2011 07:06:09 +0000 Received: from localhost (localhost.localdomain [127.0.0.1]) by smtp40.relay.iad1a.emailsrvr.com (SMTP Server) with ESMTP id 5002A350AF3; Wed, 12 Jan 2011 02:02:26 -0500 (EST) X-Virus-Scanned: OK Received: by smtp40.relay.iad1a.emailsrvr.com (Authenticated sender: adarsh.sharma-AT-orkash.com) with ESMTPSA id 745D6350302 for ; Wed, 12 Jan 2011 02:02:23 -0500 (EST) Message-ID: <4D2D52F0.9020203@orkash.com> Date: Wed, 12 Jan 2011 12:36:24 +0530 From: Adarsh Sharma User-Agent: Thunderbird 2.0.0.22 (X11/20090625) MIME-Version: 1.0 To: user@hive.apache.org Subject: Re: Hive/Hbase Integration Error References: <4D259AAA.5020606@orkash.com> <9CC5CBBD-97B1-4302-B443-0E23C943440F@fb.com> <4D26AA69.9060200@orkash.com> <77677D44-46FE-47C3-AEF6-B78AB167DCA6@fb.com> <4D270CEC.9010102@orkash.com> <4D2A9A54.7040301@orkash.com> <4D2AA93F.1080708@orkash.com> <4D2C5485.7050904@orkash.com> In-Reply-To: Content-Type: multipart/mixed; boundary="------------020406090701070405000403" X-Virus-Checked: Checked by ClamAV on apache.org This is a multi-part message in MIME format. --------------020406090701070405000403 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Jean-Daniel Cryans wrote: > Can you confirm that the machine you're running hive from can "telnet > 192.168.1.101 2181" and pals? Can it even ping? If not, then either > the problem is that the machine cannot reach your zookeeper servers or > they aren't running. There's not that many other options. > > J-D > Sir , I am able to ssh and ping to these zookeeper servers successfully as shown below : hadoop@s2-ratw-1:~/project/hadoop-0.20.2$ ping 192.168.1.101 PING 192.168.1.101 (192.168.1.101) 56(84) bytes of data. 64 bytes from 192.168.1.101: icmp_seq=1 ttl=64 time=0.142 ms 64 bytes from 192.168.1.101: icmp_seq=2 ttl=64 time=0.130 ms 64 bytes from 192.168.1.101: icmp_seq=3 ttl=64 time=0.109 ms But My problem is my Zookeper Servers are not running properly. I am using zookeeepr-3.2.2 jar which is in hbase-0.20.3/lib and also in Hive/build/dist/lib folder. Is it necessary to configure Zookeeper separately or not. I think this is true for large clusters. Thanks & Regards Adarsh Sharma I didn't configure zookeeper separately. I doubt that this might not be the issue. I attached my zookeeper logs and hbase-site.xml. --------------020406090701070405000403 Content-Type: text/x-log; name="hbase-hadoop-zookeeper-s4-ser.log" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline; filename="hbase-hadoop-zookeeper-s4-ser.log" Wed Jan 12 11:54:47 IST 2011 Starting zookeeper on s4-ser ulimit -n 1024 2011-01-12 11:54:47,705 INFO org.apache.zookeeper.server.quorum.QuorumPee= rConfig: Defaulting to majority quorums 2011-01-12 11:54:47,763 DEBUG org.apache.hadoop.hbase.zookeeper.HQuorumPe= er: preRegister called. Server=3Dcom.sun.jmx.mbeanserver.JmxMBeanServer@1= cb8deef, name=3Dlog4j:logger=3Dorg.apache.hadoop.hbase.zookeeper.HQuorumP= eer 2011-01-12 11:54:47,764 DEBUG org.apache.hadoop.hbase: preRegister called= =2E Server=3Dcom.sun.jmx.mbeanserver.JmxMBeanServer@1cb8deef, name=3Dlog4= j:logger=3Dorg.apache.hadoop.hbase 2011-01-12 11:54:47,764 INFO org.apache.zookeeper.server.quorum.QuorumPee= rMain: Starting quorum peer 2011-01-12 11:54:47,799 INFO org.apache.zookeeper.server.quorum.QuorumCnx= Manager: My election bind port: 3888 2011-01-12 11:54:47,820 INFO org.apache.zookeeper.server.quorum.QuorumPee= r: LOOKING 2011-01-12 11:54:47,822 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: New election: -1 2011-01-12 11:54:47,824 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Notification: 1, -1, 1, 0, LOOKING, LOOKING, 1 2011-01-12 11:54:47,824 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Updating proposal 2011-01-12 11:54:47,824 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Adding vote 2011-01-12 11:54:47,825 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Notification: 0, -1, 1, 0, LOOKING, LOOKING, 0 2011-01-12 11:54:47,825 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Adding vote 2011-01-12 11:54:47,825 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Notification: 1, -1, 1, 0, LOOKING, LOOKING, 0 2011-01-12 11:54:47,825 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Adding vote 2011-01-12 11:54:47,827 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Notification: 2, -1, 1, 0, LOOKING, LOOKING, 2 2011-01-12 11:54:47,827 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Updating proposal 2011-01-12 11:54:47,827 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Adding vote 2011-01-12 11:54:47,828 INFO org.apache.zookeeper.server.quorum.QuorumPee= r: FOLLOWING 2011-01-12 11:54:47,828 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Sending new notification. 2011-01-12 11:54:47,830 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Sending new notification. 2011-01-12 11:54:47,830 INFO org.apache.zookeeper.server.quorum.Follower:= TCP NoDelay set to: true 2011-01-12 11:54:47,838 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:zookeeper.version=3D3.2.2-888565, built on 12/08/2009= 21:51 GMT 2011-01-12 11:54:47,838 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:host.name=3Ds4-ser 2011-01-12 11:54:47,838 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:java.version=3D1.6.0_20 2011-01-12 11:54:47,838 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:java.vendor=3DSun Microsystems Inc. 2011-01-12 11:54:47,838 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:java.home=3D/usr/java/jdk1.6.0_20/jre 2011-01-12 11:54:47,838 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:java.class.path=3D/home/hadoop/project/hbase-0.20.3/c= onf:/usr/java/jdk1.6.0_20/lib/tools.jar:/home/hadoop/project/hbase-0.20.3= :/home/hadoop/project/hbase-0.20.3/hbase-0.20.3.jar:/home/hadoop/project/= hbase-0.20.3/hbase-0.20.3-test.jar:/home/hadoop/project/hbase-0.20.3/lib/= AgileJSON-2009-03-30.jar:/home/hadoop/project/hbase-0.20.3/lib/commons-cl= i-2.0-SNAPSHOT.jar:/home/hadoop/project/hbase-0.20.3/lib/commons-el-from-= jetty-5.1.4.jar:/home/hadoop/project/hbase-0.20.3/lib/commons-httpclient-= 3.0.1.jar:/home/hadoop/project/hbase-0.20.3/lib/commons-logging-1.0.4.jar= :/home/hadoop/project/hbase-0.20.3/lib/commons-logging-api-1.0.4.jar:/hom= e/hadoop/project/hbase-0.20.3/lib/commons-math-1.1.jar:/home/hadoop/proje= ct/hbase-0.20.3/lib/hadoop-0.20.1-hdfs127-core.jar:/home/hadoop/project/h= base-0.20.3/lib/hadoop-0.20.1-test.jar:/home/hadoop/project/hbase-0.20.3/= lib/jasper-compiler-5.5.12.jar:/home/hadoop/project/hbase-0.20.3/lib/jasp= er-runtime-5.5.12.jar:/home/hadoop/project/hbase-0.20.3/lib/jetty-6.1.14.= jar:/home/hadoop/project/hbase-0.20.3/lib/jetty-util-6.1.14.jar:/home/had= oop/project/hbase-0.20.3/lib/jruby-complete-1.2.0.jar:/home/hadoop/projec= t/hbase-0.20.3/lib/json.jar:/home/hadoop/project/hbase-0.20.3/lib/junit-3= =2E8.1.jar:/home/hadoop/project/hbase-0.20.3/lib/libthrift-r771587.jar:/h= ome/hadoop/project/hbase-0.20.3/lib/log4j-1.2.15.jar:/home/hadoop/project= /hbase-0.20.3/lib/lucene-core-2.2.0.jar:/home/hadoop/project/hbase-0.20.3= /lib/servlet-api-2.5-6.1.14.jar:/home/hadoop/project/hbase-0.20.3/lib/xml= enc-0.52.jar:/home/hadoop/project/hbase-0.20.3/lib/zookeeper-3.2.2.jar:/h= ome/hadoop/project/hbase-0.20.3/lib/jsp-2.1/jsp-2.1.jar:/home/hadoop/proj= ect/hbase-0.20.3/lib/jsp-2.1/jsp-api-2.1.jar 2011-01-12 11:54:47,838 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:java.library.path=3D/home/hadoop/project/hbase-0.20.3= /lib/native/Linux-amd64-64 2011-01-12 11:54:47,838 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:java.io.tmpdir=3D/tmp 2011-01-12 11:54:47,838 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:java.compiler=3D 2011-01-12 11:54:47,838 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:os.name=3DLinux 2011-01-12 11:54:47,838 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:os.arch=3Damd64 2011-01-12 11:54:47,838 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:os.version=3D2.6.32-24-server 2011-01-12 11:54:47,838 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:user.name=3Dhadoop 2011-01-12 11:54:47,838 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:user.home=3D/home/hadoop 2011-01-12 11:54:47,838 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:user.dir=3D/home/hadoop/project/hbase-0.20.3 2011-01-12 11:54:47,839 INFO org.apache.zookeeper.server.ZooKeeperServer:= Created server 2011-01-12 11:54:47,842 INFO org.apache.zookeeper.server.quorum.Follower:= Following /192.168.1.115:2888 2011-01-12 11:54:47,847 WARN org.apache.zookeeper.server.quorum.Follower:= Unexpected exception, tries=3D0 java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333) at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195) at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) at java.net.Socket.connect(Socket.java:529) at org.apache.zookeeper.server.quorum.Follower.followLeader(Follower.jav= a:156) at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:525= ) 2011-01-12 11:54:48,863 INFO org.apache.zookeeper.server.quorum.Follower:= Getting a snapshot from leader 2011-01-12 11:54:48,890 INFO org.apache.zookeeper.server.persistence.File= TxnSnapLog: Snapshotting: 100000000 2011-01-12 11:54:50,260 WARN org.apache.zookeeper.server.quorum.Follower:= Got zxid 0x100000001 expected 0x1 2011-01-12 11:54:50,921 INFO org.apache.zookeeper.server.NIOServerCnxn: C= onnected to /192.168.1.107:52661 lastZxid 0 2011-01-12 11:54:50,921 INFO org.apache.zookeeper.server.NIOServerCnxn: C= reating new session 0x2d78e5e6f10000 2011-01-12 11:54:50,944 INFO org.apache.zookeeper.server.NIOServerCnxn: F= inished init of 0x2d78e5e6f10000 valid:true --------------020406090701070405000403 Content-Type: text/x-log; name="hbase-hadoop-zookeeper-s14-apps.log" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline; filename="hbase-hadoop-zookeeper-s14-apps.log" Wed Jan 12 11:54:48 IST 2011 Starting zookeeper on s14-apps ulimit -n 1024 2011-01-12 11:54:48,705 INFO org.apache.zookeeper.server.quorum.QuorumPee= rConfig: Defaulting to majority quorums 2011-01-12 11:54:48,763 DEBUG org.apache.hadoop.hbase.zookeeper.HQuorumPe= er: preRegister called. Server=3Dcom.sun.jmx.mbeanserver.JmxMBeanServer@2= d342ba4, name=3Dlog4j:logger=3Dorg.apache.hadoop.hbase.zookeeper.HQuorumP= eer 2011-01-12 11:54:48,763 DEBUG org.apache.hadoop.hbase: preRegister called= =2E Server=3Dcom.sun.jmx.mbeanserver.JmxMBeanServer@2d342ba4, name=3Dlog4= j:logger=3Dorg.apache.hadoop.hbase 2011-01-12 11:54:48,763 INFO org.apache.zookeeper.server.quorum.QuorumPee= rMain: Starting quorum peer 2011-01-12 11:54:48,798 INFO org.apache.zookeeper.server.quorum.QuorumCnx= Manager: My election bind port: 3888 2011-01-12 11:54:48,823 INFO org.apache.zookeeper.server.quorum.QuorumPee= r: LOOKING 2011-01-12 11:54:48,825 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: New election: -1 2011-01-12 11:54:48,854 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Notification: 1, -1, 1, 1, LOOKING, LOOKING, 1 2011-01-12 11:54:48,854 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Adding vote 2011-01-12 11:54:48,858 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Notification: 0, -1, 1, 1, LOOKING, LOOKING, 0 2011-01-12 11:54:48,858 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Adding vote 2011-01-12 11:54:48,858 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Notification: 1, -1, 1, 1, LOOKING, LOOKING, 0 2011-01-12 11:54:48,859 INFO org.apache.zookeeper.server.quorum.QuorumCnx= Manager: Have smaller server identifier, so dropping the connection: (2, = 1) 2011-01-12 11:54:48,859 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Adding vote 2011-01-12 11:54:48,861 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Notification: 2, -1, 1, 1, LOOKING, LOOKING, 0 2011-01-12 11:54:48,861 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Updating proposal 2011-01-12 11:54:48,861 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Adding vote 2011-01-12 11:54:48,862 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Notification: 2, -1, 1, 1, LOOKING, LOOKING, 2 2011-01-12 11:54:48,862 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Adding vote 2011-01-12 11:54:48,863 INFO org.apache.zookeeper.server.quorum.QuorumPee= r: FOLLOWING 2011-01-12 11:54:48,869 INFO org.apache.zookeeper.server.quorum.Follower:= TCP NoDelay set to: true 2011-01-12 11:54:48,878 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:zookeeper.version=3D3.2.2-888565, built on 12/08/2009= 21:51 GMT 2011-01-12 11:54:48,878 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:host.name=3Ds14-apps 2011-01-12 11:54:48,878 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:java.version=3D1.6.0_20 2011-01-12 11:54:48,878 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:java.vendor=3DSun Microsystems Inc. 2011-01-12 11:54:48,878 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:java.home=3D/usr/java/jdk1.6.0_20/jre 2011-01-12 11:54:48,878 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:java.class.path=3D/home/hadoop/project/hbase-0.20.3/c= onf:/usr/java/jdk1.6.0_20/lib/tools.jar:/home/hadoop/project/hbase-0.20.3= :/home/hadoop/project/hbase-0.20.3/hbase-0.20.3.jar:/home/hadoop/project/= hbase-0.20.3/hbase-0.20.3-test.jar:/home/hadoop/project/hbase-0.20.3/lib/= AgileJSON-2009-03-30.jar:/home/hadoop/project/hbase-0.20.3/lib/commons-cl= i-2.0-SNAPSHOT.jar:/home/hadoop/project/hbase-0.20.3/lib/commons-el-from-= jetty-5.1.4.jar:/home/hadoop/project/hbase-0.20.3/lib/commons-httpclient-= 3.0.1.jar:/home/hadoop/project/hbase-0.20.3/lib/commons-logging-1.0.4.jar= :/home/hadoop/project/hbase-0.20.3/lib/commons-logging-api-1.0.4.jar:/hom= e/hadoop/project/hbase-0.20.3/lib/commons-math-1.1.jar:/home/hadoop/proje= ct/hbase-0.20.3/lib/hadoop-0.20.1-hdfs127-core.jar:/home/hadoop/project/h= base-0.20.3/lib/hadoop-0.20.1-test.jar:/home/hadoop/project/hbase-0.20.3/= lib/jasper-compiler-5.5.12.jar:/home/hadoop/project/hbase-0.20.3/lib/jasp= er-runtime-5.5.12.jar:/home/hadoop/project/hbase-0.20.3/lib/jetty-6.1.14.= jar:/home/hadoop/project/hbase-0.20.3/lib/jetty-util-6.1.14.jar:/home/had= oop/project/hbase-0.20.3/lib/jruby-complete-1.2.0.jar:/home/hadoop/projec= t/hbase-0.20.3/lib/json.jar:/home/hadoop/project/hbase-0.20.3/lib/junit-3= =2E8.1.jar:/home/hadoop/project/hbase-0.20.3/lib/libthrift-r771587.jar:/h= ome/hadoop/project/hbase-0.20.3/lib/log4j-1.2.15.jar:/home/hadoop/project= /hbase-0.20.3/lib/lucene-core-2.2.0.jar:/home/hadoop/project/hbase-0.20.3= /lib/servlet-api-2.5-6.1.14.jar:/home/hadoop/project/hbase-0.20.3/lib/xml= enc-0.52.jar:/home/hadoop/project/hbase-0.20.3/lib/zookeeper-3.2.2.jar:/h= ome/hadoop/project/hbase-0.20.3/lib/jsp-2.1/jsp-2.1.jar:/home/hadoop/proj= ect/hbase-0.20.3/lib/jsp-2.1/jsp-api-2.1.jar 2011-01-12 11:54:48,878 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:java.library.path=3D/home/hadoop/project/hbase-0.20.3= /lib/native/Linux-amd64-64 2011-01-12 11:54:48,878 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:java.io.tmpdir=3D/tmp 2011-01-12 11:54:48,878 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:java.compiler=3D 2011-01-12 11:54:48,878 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:os.name=3DLinux 2011-01-12 11:54:48,878 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:os.arch=3Damd64 2011-01-12 11:54:48,878 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:os.version=3D2.6.32-24-server 2011-01-12 11:54:48,878 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:user.name=3Dhadoop 2011-01-12 11:54:48,878 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:user.home=3D/home/hadoop 2011-01-12 11:54:48,879 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:user.dir=3D/home/hadoop/project/hbase-0.20.3 2011-01-12 11:54:48,880 INFO org.apache.zookeeper.server.ZooKeeperServer:= Created server 2011-01-12 11:54:48,882 INFO org.apache.zookeeper.server.quorum.Follower:= Following /192.168.1.115:2888 2011-01-12 11:54:48,889 WARN org.apache.zookeeper.server.quorum.Follower:= Unexpected exception, tries=3D0 java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333) at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195) at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) at java.net.Socket.connect(Socket.java:529) at org.apache.zookeeper.server.quorum.Follower.followLeader(Follower.jav= a:156) at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:525= ) 2011-01-12 11:54:49,902 INFO org.apache.zookeeper.server.quorum.Follower:= Getting a snapshot from leader 2011-01-12 11:54:49,933 INFO org.apache.zookeeper.server.persistence.File= TxnSnapLog: Snapshotting: 100000000 2011-01-12 11:54:51,279 INFO org.apache.zookeeper.server.NIOServerCnxn: C= onnected to /192.168.1.102:46340 lastZxid 0 2011-01-12 11:54:51,279 INFO org.apache.zookeeper.server.NIOServerCnxn: C= reating new session 0x12d78e5eb040000 2011-01-12 11:54:51,285 INFO org.apache.zookeeper.server.NIOServerCnxn: C= onnected to /192.168.1.111:51045 lastZxid 0 2011-01-12 11:54:51,286 INFO org.apache.zookeeper.server.NIOServerCnxn: C= reating new session 0x12d78e5eb040001 2011-01-12 11:54:51,292 WARN org.apache.zookeeper.server.quorum.Follower:= Got zxid 0x100000001 expected 0x1 2011-01-12 11:54:51,299 INFO org.apache.zookeeper.server.NIOServerCnxn: C= onnected to /192.168.1.110:57212 lastZxid 0 2011-01-12 11:54:51,300 INFO org.apache.zookeeper.server.NIOServerCnxn: C= reating new session 0x12d78e5eb040002 2011-01-12 11:54:51,355 INFO org.apache.zookeeper.server.NIOServerCnxn: F= inished init of 0x12d78e5eb040000 valid:true 2011-01-12 11:54:51,357 INFO org.apache.zookeeper.server.NIOServerCnxn: F= inished init of 0x12d78e5eb040001 valid:true 2011-01-12 11:54:51,358 INFO org.apache.zookeeper.server.NIOServerCnxn: F= inished init of 0x12d78e5eb040002 valid:true 2011-01-12 11:54:51,654 INFO org.apache.zookeeper.server.NIOServerCnxn: C= onnected to /192.168.1.101:43088 lastZxid 0 2011-01-12 11:54:51,654 INFO org.apache.zookeeper.server.NIOServerCnxn: C= reating new session 0x12d78e5eb040003 2011-01-12 11:54:51,658 INFO org.apache.zookeeper.server.NIOServerCnxn: C= onnected to /192.168.1.103:52976 lastZxid 0 2011-01-12 11:54:51,658 INFO org.apache.zookeeper.server.NIOServerCnxn: C= reating new session 0x12d78e5eb040004 2011-01-12 11:54:51,663 INFO org.apache.zookeeper.server.NIOServerCnxn: F= inished init of 0x12d78e5eb040003 valid:true 2011-01-12 11:54:51,672 INFO org.apache.zookeeper.server.NIOServerCnxn: F= inished init of 0x12d78e5eb040004 valid:true --------------020406090701070405000403 Content-Type: text/x-log; name="hbase-hadoop-zookeeper-s15-ser.log" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline; filename="hbase-hadoop-zookeeper-s15-ser.log" Wed Jan 12 11:54:47 IST 2011 Starting zookeeper on s15-ser ulimit -n 1024 2011-01-12 11:54:47,621 INFO org.apache.zookeeper.server.quorum.QuorumPee= rConfig: Defaulting to majority quorums 2011-01-12 11:54:47,679 DEBUG org.apache.hadoop.hbase.zookeeper.HQuorumPe= er: preRegister called. Server=3Dcom.sun.jmx.mbeanserver.JmxMBeanServer@1= cb8deef, name=3Dlog4j:logger=3Dorg.apache.hadoop.hbase.zookeeper.HQuorumP= eer 2011-01-12 11:54:47,680 DEBUG org.apache.hadoop.hbase: preRegister called= =2E Server=3Dcom.sun.jmx.mbeanserver.JmxMBeanServer@1cb8deef, name=3Dlog4= j:logger=3Dorg.apache.hadoop.hbase 2011-01-12 11:54:47,680 INFO org.apache.zookeeper.server.quorum.QuorumPee= rMain: Starting quorum peer 2011-01-12 11:54:47,715 INFO org.apache.zookeeper.server.quorum.QuorumCnx= Manager: My election bind port: 3888 2011-01-12 11:54:47,739 INFO org.apache.zookeeper.server.quorum.QuorumPee= r: LOOKING 2011-01-12 11:54:47,741 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: New election: -1 2011-01-12 11:54:47,768 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Notification: 0, -1, 1, 2, LOOKING, LOOKING, 0 2011-01-12 11:54:47,768 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Adding vote 2011-01-12 11:54:47,768 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Notification: 2, -1, 1, 2, LOOKING, LOOKING, 2 2011-01-12 11:54:47,769 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Adding vote 2011-01-12 11:54:47,769 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Notification: 1, -1, 1, 2, LOOKING, LOOKING, 0 2011-01-12 11:54:47,769 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Adding vote 2011-01-12 11:54:47,769 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Notification: 2, -1, 1, 2, LOOKING, LOOKING, 0 2011-01-12 11:54:47,769 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: Adding vote 2011-01-12 11:54:47,970 INFO org.apache.zookeeper.server.quorum.FastLeade= rElection: About to leave instance:2, -1, 2, LEADING 2011-01-12 11:54:47,971 INFO org.apache.zookeeper.server.quorum.QuorumPee= r: LEADING 2011-01-12 11:54:47,975 INFO org.apache.zookeeper.server.quorum.Leader: T= CP NoDelay set to: true 2011-01-12 11:54:47,990 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:zookeeper.version=3D3.2.2-888565, built on 12/08/2009= 21:51 GMT 2011-01-12 11:54:47,990 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:host.name=3Ds15-ser 2011-01-12 11:54:47,990 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:java.version=3D1.6.0_20 2011-01-12 11:54:47,990 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:java.vendor=3DSun Microsystems Inc. 2011-01-12 11:54:47,990 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:java.home=3D/usr/java/jdk1.6.0_20/jre 2011-01-12 11:54:47,990 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:java.class.path=3D/home/hadoop/project/hbase-0.20.3/c= onf:/usr/java/jdk1.6.0_20/lib/tools.jar:/home/hadoop/project/hbase-0.20.3= :/home/hadoop/project/hbase-0.20.3/hbase-0.20.3.jar:/home/hadoop/project/= hbase-0.20.3/hbase-0.20.3-test.jar:/home/hadoop/project/hbase-0.20.3/lib/= AgileJSON-2009-03-30.jar:/home/hadoop/project/hbase-0.20.3/lib/commons-cl= i-2.0-SNAPSHOT.jar:/home/hadoop/project/hbase-0.20.3/lib/commons-el-from-= jetty-5.1.4.jar:/home/hadoop/project/hbase-0.20.3/lib/commons-httpclient-= 3.0.1.jar:/home/hadoop/project/hbase-0.20.3/lib/commons-logging-1.0.4.jar= :/home/hadoop/project/hbase-0.20.3/lib/commons-logging-api-1.0.4.jar:/hom= e/hadoop/project/hbase-0.20.3/lib/commons-math-1.1.jar:/home/hadoop/proje= ct/hbase-0.20.3/lib/hadoop-0.20.1-hdfs127-core.jar:/home/hadoop/project/h= base-0.20.3/lib/hadoop-0.20.1-test.jar:/home/hadoop/project/hbase-0.20.3/= lib/jasper-compiler-5.5.12.jar:/home/hadoop/project/hbase-0.20.3/lib/jasp= er-runtime-5.5.12.jar:/home/hadoop/project/hbase-0.20.3/lib/jetty-6.1.14.= jar:/home/hadoop/project/hbase-0.20.3/lib/jetty-util-6.1.14.jar:/home/had= oop/project/hbase-0.20.3/lib/jruby-complete-1.2.0.jar:/home/hadoop/projec= t/hbase-0.20.3/lib/json.jar:/home/hadoop/project/hbase-0.20.3/lib/junit-3= =2E8.1.jar:/home/hadoop/project/hbase-0.20.3/lib/libthrift-r771587.jar:/h= ome/hadoop/project/hbase-0.20.3/lib/log4j-1.2.15.jar:/home/hadoop/project= /hbase-0.20.3/lib/lucene-core-2.2.0.jar:/home/hadoop/project/hbase-0.20.3= /lib/servlet-api-2.5-6.1.14.jar:/home/hadoop/project/hbase-0.20.3/lib/xml= enc-0.52.jar:/home/hadoop/project/hbase-0.20.3/lib/zookeeper-3.2.2.jar:/h= ome/hadoop/project/hbase-0.20.3/lib/jsp-2.1/jsp-2.1.jar:/home/hadoop/proj= ect/hbase-0.20.3/lib/jsp-2.1/jsp-api-2.1.jar 2011-01-12 11:54:47,990 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:java.library.path=3D/home/hadoop/project/hbase-0.20.3= /lib/native/Linux-amd64-64 2011-01-12 11:54:47,990 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:java.io.tmpdir=3D/tmp 2011-01-12 11:54:47,991 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:java.compiler=3D 2011-01-12 11:54:47,991 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:os.name=3DLinux 2011-01-12 11:54:47,991 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:os.arch=3Damd64 2011-01-12 11:54:47,991 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:os.version=3D2.6.32-24-server 2011-01-12 11:54:47,991 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:user.name=3Dhadoop 2011-01-12 11:54:47,991 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:user.home=3D/home/hadoop 2011-01-12 11:54:47,991 INFO org.apache.zookeeper.server.ZooKeeperServer:= Server environment:user.dir=3D/home/hadoop/project/hbase-0.20.3 2011-01-12 11:54:47,992 INFO org.apache.zookeeper.server.ZooKeeperServer:= Created server 2011-01-12 11:54:48,004 INFO org.apache.zookeeper.server.persistence.File= TxnSnapLog: Snapshotting: 0 2011-01-12 11:54:48,800 INFO org.apache.zookeeper.server.quorum.FollowerH= andler: Follower sid: 0 : info : org.apache.zookeeper.server.quorum.Quoru= mPeer$QuorumServer@6f878144 2011-01-12 11:54:48,801 WARN org.apache.zookeeper.server.quorum.FollowerH= andler: Sending snapshot last zxid of peer is 0xffffffffffffffff zxid of= leader is 0x100000000 2011-01-12 11:54:48,807 INFO org.apache.zookeeper.server.quorum.FollowerH= andler: Follower sid: 1 : info : org.apache.zookeeper.server.quorum.Quoru= mPeer$QuorumServer@26858bf1 2011-01-12 11:54:48,807 WARN org.apache.zookeeper.server.quorum.FollowerH= andler: Sending snapshot last zxid of peer is 0xffffffffffffffff zxid of= leader is 0x100000000 2011-01-12 11:54:48,818 WARN org.apache.zookeeper.server.quorum.Leader: C= ommiting zxid 0x100000000 from /192.168.1.115:2888 not first! 2011-01-12 11:54:48,818 WARN org.apache.zookeeper.server.quorum.Leader: F= irst is 0 2011-01-12 11:54:49,788 WARN org.apache.zookeeper.server.NIOServerCnxn: E= xception causing close of session 0x0 due to java.io.IOException: ZooKeep= erServer not running 2011-01-12 11:54:49,788 INFO org.apache.zookeeper.server.NIOServerCnxn: c= losing session:0x0 NIOServerCnxn: java.nio.channels.SocketChannel[connect= ed local=3D/192.168.1.115:2222 remote=3D/192.168.1.102:33389] 2011-01-12 11:54:50,190 WARN org.apache.zookeeper.server.NIOServerCnxn: E= xception causing close of session 0x0 due to java.io.IOException: ZooKeep= erServer not running 2011-01-12 11:54:50,191 INFO org.apache.zookeeper.server.NIOServerCnxn: c= losing session:0x0 NIOServerCnxn: java.nio.channels.SocketChannel[connect= ed local=3D/192.168.1.115:2222 remote=3D/192.168.1.107:60717] 2011-01-12 11:54:50,326 WARN org.apache.zookeeper.server.PrepRequestProce= ssor: Got exception when processing sessionid:0x12d78e5eb040000 type:crea= te cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown n/a=20 org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode= =3D NodeExists at org.apache.zookeeper.server.PrepRequestProcessor.pRequest(PrepRequest= Processor.java:245) at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProce= ssor.java:114) 2011-01-12 11:54:54,051 WARN org.apache.zookeeper.server.PrepRequestProce= ssor: Got exception when processing sessionid:0x12d78e5eb040002 type:crea= te cxid:0x5 zxid:0xfffffffffffffffe txntype:unknown n/a=20 org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode= =3D NodeExists at org.apache.zookeeper.server.PrepRequestProcessor.pRequest(PrepRequest= Processor.java:245) at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProce= ssor.java:114) 2011-01-12 11:54:54,052 WARN org.apache.zookeeper.server.PrepRequestProce= ssor: Got exception when processing sessionid:0x12d78e5eb040001 type:crea= te cxid:0x5 zxid:0xfffffffffffffffe txntype:unknown n/a=20 org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode= =3D NodeExists at org.apache.zookeeper.server.PrepRequestProcessor.pRequest(PrepRequest= Processor.java:245) at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProce= ssor.java:114) 2011-01-12 11:54:54,058 WARN org.apache.zookeeper.server.PrepRequestProce= ssor: Got exception when processing sessionid:0x12d78e5eb040003 type:crea= te cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown n/a=20 org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode= =3D NodeExists at org.apache.zookeeper.server.PrepRequestProcessor.pRequest(PrepRequest= Processor.java:245) at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProce= ssor.java:114) 2011-01-12 11:54:54,065 WARN org.apache.zookeeper.server.PrepRequestProce= ssor: Got exception when processing sessionid:0x12d78e5eb040004 type:crea= te cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown n/a=20 org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode= =3D NodeExists at org.apache.zookeeper.server.PrepRequestProcessor.pRequest(PrepRequest= Processor.java:245) at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProce= ssor.java:114) 2011-01-12 11:54:54,859 WARN org.apache.zookeeper.server.PrepRequestProce= ssor: Got exception when processing sessionid:0x12d78e5eb040002 type:crea= te cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown n/a=20 org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode= =3D NodeExists at org.apache.zookeeper.server.PrepRequestProcessor.pRequest(PrepRequest= Processor.java:245) at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProce= ssor.java:114) 2011-01-12 11:54:55,868 WARN org.apache.zookeeper.server.PrepRequestProce= ssor: Got exception when processing sessionid:0x12d78e5eb040000 type:crea= te cxid:0x14 zxid:0xfffffffffffffffe txntype:unknown n/a=20 org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode= =3D NodeExists at org.apache.zookeeper.server.PrepRequestProcessor.pRequest(PrepRequest= Processor.java:245) at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProce= ssor.java:114) 2011-01-12 11:54:55,895 WARN org.apache.zookeeper.server.PrepRequestProce= ssor: Got exception when processing sessionid:0x12d78e5eb040000 type:crea= te cxid:0x16 zxid:0xfffffffffffffffe txntype:unknown n/a=20 org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode= =3D NodeExists at org.apache.zookeeper.server.PrepRequestProcessor.pRequest(PrepRequest= Processor.java:245) at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProce= ssor.java:114) 2011-01-12 11:54:56,089 WARN org.apache.zookeeper.server.PrepRequestProce= ssor: Got exception when processing sessionid:0x12d78e5eb040004 type:crea= te cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown n/a=20 org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode= =3D NodeExists at org.apache.zookeeper.server.PrepRequestProcessor.pRequest(PrepRequest= Processor.java:245) at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProce= ssor.java:114) --------------020406090701070405000403 Content-Type: text/xml; name="hbase-site.xml" Content-Transfer-Encoding: 7bit Content-Disposition: inline; filename="hbase-site.xml" hbase.rootdir hdfs://ws-test:54310/hbase The directory shared by region servers. hbase.cluster.distributed true The mode the cluster will be in. Possible values are false: standalone and pseudo-distributed setups with managed Zookeeper true: fully-distributed with unmanaged Zookeeper Quorum (see hbase-env.sh) hbase.zookeeper.property.clientPort 2222 Property from ZooKeeper's config zoo.cfg. The port at which the clients will connect. hbase.zookeeper.quorum 192.168.1.101,192.168.1.114,192.168.1.115 Comma separated list of servers in the ZooKeeper Quorum. For example, "host1.mydomain.com,host2.mydomain.com,host3.mydomain.com". By default this is set to localhost for local and pseudo-distributed modes of operation. For a fully-distributed setup, this should be set to a full list of ZooKeeper quorum servers. If HBASE_MANAGES_ZK is set in hbase-env.sh this is the list of servers which we will start/stop ZooKeeper on. --------------020406090701070405000403--