Return-Path: Delivered-To: apmail-hbase-user-archive@www.apache.org Received: (qmail 37725 invoked from network); 22 Nov 2010 05:36:15 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 22 Nov 2010 05:36:15 -0000 Received: (qmail 4086 invoked by uid 500); 22 Nov 2010 05:36:46 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 4047 invoked by uid 500); 22 Nov 2010 05:36:45 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 4039 invoked by uid 99); 22 Nov 2010 05:36:45 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Nov 2010 05:36:45 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=FREEMAIL_FROM,HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of yuzhihong@gmail.com designates 209.85.161.41 as permitted sender) Received: from [209.85.161.41] (HELO mail-fx0-f41.google.com) (209.85.161.41) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Nov 2010 05:36:38 +0000 Received: by fxm20 with SMTP id 20so4332654fxm.14 for ; Sun, 21 Nov 2010 21:36:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:content-type; bh=RLscTb3+X/XNt9BlA4O7IAMMvDBxawfBR13wTyD2n08=; b=iHUcGA/SexOZip8PiKscgU6w7juuPq+pKLrbyyZyn5gcCieVwJp8I5FOegjMT1VV+Y JQQnNHZeGQeMiZOK4V0xUExXQxbdQlCeaxYba0gSkmyaOer3GQJxWedksdWPsL6SJKS7 pzzbfRF/KLEPAGf2D7R+g7C+4MJTMW+4ZA3AQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=QtybyWVyo8EnndsMxS9oVwNEv01SIrrBQfc8Rr+AH4VSWQV8JzkKj1Qm6rnGhMTJv4 Fh3WTfC7gkk1T4VNg9X22j0Gf8fcDglapeuKoCa8wY1P3Ps8g8W+DMazSAN4T5T+bdt/ mdIZQPRLpfoSyolIx2VjqU1lhzEPGRbbZulbQ= MIME-Version: 1.0 Received: by 10.223.71.207 with SMTP id i15mr3690410faj.9.1290404177832; Sun, 21 Nov 2010 21:36:17 -0800 (PST) Received: by 10.223.72.6 with HTTP; Sun, 21 Nov 2010 21:36:17 -0800 (PST) In-Reply-To: References: Date: Sun, 21 Nov 2010 21:36:17 -0800 Message-ID: Subject: Re: Question about Zookeeper quorum From: Ted Yu To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=20cf3054a645a2ed2404959da22c X-Virus-Checked: Checked by ClamAV on apache.org --20cf3054a645a2ed2404959da22c Content-Type: text/plain; charset=ISO-8859-1 The default is true: bin/zookeepers.sh:if [ "$HBASE_MANAGES_ZK" = "" ]; then bin/zookeepers.sh: HBASE_MANAGES_ZK=true On Sun, Nov 21, 2010 at 9:19 PM, Hari Sreekumar wrote: > Hey Lars, > > I have HQuorumPeer running on all nodes that I specify in my > hbase-site file. One thing I wanted to clarify.. what is the default value > of HBASE_MANAGES_ZK ? Because I have not explicitly set it to true in my > hbase-env.sh file. > > thanks, > hari > > On Mon, Nov 22, 2010 at 10:39 AM, Lars George > wrote: > > > Hi Hari, > > > > On which of these for machines do you have a ZooKeeper daemon running as > > well? > > > > Lars > > > > On Mon, Nov 22, 2010 at 5:51 AM, Hari Sreekumar > > wrote: > > > Hi, > > > > > > But it is reading settings from hbase-site.xml. If it was not > reading > > my > > > changes, the problem wouldn't have gotten fixed when I add ejabber to > the > > > quroum right? After all, it is responding to changes I make in my xml > > file. > > > What else can be the issue here? > > > > > > hari > > > > > > On Mon, Nov 22, 2010 at 12:54 AM, Lars George > > wrote: > > > > > >> Hi Hari, > > >> > > >> You are missing the quorum setting. It seems the hbase-site.xml is > > missing > > >> from the classpath on the clients. Did you pack it into the jar? > > >> > > >> And yes, even one ZK server is fine in such a small cluster. > > >> > > >> You can see it is trying to connect to localhost which is the default > if > > >> the site file is missing. > > >> > > >> Regards, > > >> Lars > > >> > > >> On Nov 21, 2010, at 19:22, Hari Sreekumar > > >> wrote: > > >> > > >> > Hi, > > >> > Is it necessary that all RegionServers must also be part of the > ZK > > >> > Quorum? I have a 4 node cluster, with node hadoop1 being master and > > >> hadoop2, > > >> > hadoop3 and ejabber being the slaves (Both in case of hadoop and for > > >> HBase). > > >> > > > >> > When I keep only 3 nodes in the zookeeper.quorum property: > > >> > hbase.zookeeper.quorum > > >> > hadoop1,hadoop2,hadoop3 > > >> > > > >> > I get this exception for all tasks that run on ejabber(the 4th > node): > > >> > > > >> > 2010-11-21 23:35:47,785 INFO org.apache.zookeeper.ClientCnxn: > > Attempting > > >> > connection to server localhost/127.0.0.1:2181 > > >> > 2010-11-21 23:35:47,790 WARN org.apache.zookeeper.ClientCnxn: > > Exception > > >> > closing session 0x0 to sun.nio.ch.SelectionKeyImpl@7c2e1f1f > > >> > java.net.ConnectException: Connection refused > > >> > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > > >> > at > > >> > > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574) > > >> > at > > >> > org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:933) > > >> > 2010-11-21 23:35:47,791 WARN org.apache.zookeeper.ClientCnxn: > Ignoring > > >> > exception during shutdown input > > >> > java.nio.channels.ClosedChannelException > > >> > at > > >> > > sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:638) > > >> > at > > sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) > > >> > at > > >> > > > org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:999) > > >> > at > > >> > org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:970) > > >> > 2010-11-21 23:35:47,791 WARN org.apache.zookeeper.ClientCnxn: > Ignoring > > >> > exception during shutdown output > > >> > java.nio.channels.ClosedChannelException > > >> > at > > >> > > > sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:649) > > >> > at > > sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:368) > > >> > at > > >> > > > org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1004) > > >> > at > > >> > org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:970) > > >> > 2010-11-21 23:35:47,925 WARN > > >> > org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper: Failed to create > > >> /hbase > > >> > -- check quorum servers, currently=localhost:2181 > > >> > org.apache.zookeeper.KeeperException$ConnectionLossException: > > >> > KeeperErrorCode = ConnectionLoss for /hbase > > >> > at > > >> > org.apache.zookeeper.KeeperException.create(KeeperException.java:90) > > >> > at > > >> > org.apache.zookeeper.KeeperException.create(KeeperException.java:42) > > >> > at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:780) > > >> > at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:808) > > >> > at > > >> > > > >> > > > org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.ensureExists(ZooKeeperWrapper.java:405) > > >> > at > > >> > > > >> > > > org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.ensureParentExists(ZooKeeperWrapper.java:432) > > >> > at > > >> > > > >> > > > org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.checkOutOfSafeMode(ZooKeeperWrapper.java:545) > > >> > > > >> > When I add ejabber also to the ZK quorum and restart HBase, I don't > > get > > >> this > > >> > exception. My understanding was that a small cluster like mine > should > > >> only > > >> > need one ZK machine. > > >> > > > >> > Thanks, > > >> > Hari > > >> > > > > > > --20cf3054a645a2ed2404959da22c--