Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C43D010D0A for ; Wed, 21 Aug 2013 12:46:31 +0000 (UTC) Received: (qmail 32764 invoked by uid 500); 21 Aug 2013 12:45:53 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 32570 invoked by uid 500); 21 Aug 2013 12:45:52 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 32562 invoked by uid 99); 21 Aug 2013 12:45:51 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 21 Aug 2013 12:45:51 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: error (nike.apache.org: local policy) Received: from [209.85.128.171] (HELO mail-ve0-f171.google.com) (209.85.128.171) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 21 Aug 2013 12:45:44 +0000 Received: by mail-ve0-f171.google.com with SMTP id pa12so270972veb.16 for ; Wed, 21 Aug 2013 05:45:03 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=NlSuZKgEe6QJacHBjNBnOhm0penCjR4zg8lnKLnrKfU=; b=gmQabbZAMHJH25nr5AvZ9jYfer8R5z8MfM+okCl9BUEEnQ6dRF7kBJb4gygPc5Mp1Y opq9JKNmy/BpdKjA1ixO5EleHEerMws4xLsi2nF4BqOc7ulVWbh7tI1LlA34Fzhr7rCi KGw7dw7hPcrVMQdi2XSEnkNSYvMYW1NmWyy1e0I1DJrpQNXWbEIa3Jxz6oPd9XsXKcr7 +e6wFp4xsoMryVxsikXFqg8fk/26sHFXU0OD4bk3k42fR4KSaR6WssXyUtJhCJ9fWzXP Alk8Bic+fwQWpcHBEa9EIjThYyBPG7aqfgQHZkmsZJFMmvacAkP6xlto1goFklSI1ySJ AeTg== X-Gm-Message-State: ALoCoQmC6zIppVcti3yBimfc3gsSjoQVYXwcH9AbYASOmFhBVqMEbD+7s4UCV7wyjH8yci0zdhHP X-Received: by 10.220.199.5 with SMTP id eq5mr6356429vcb.16.1377089103597; Wed, 21 Aug 2013 05:45:03 -0700 (PDT) MIME-Version: 1.0 Received: by 10.52.35.82 with HTTP; Wed, 21 Aug 2013 05:44:43 -0700 (PDT) In-Reply-To: References: From: Jean-Marc Spaggiari Date: Wed, 21 Aug 2013 08:44:43 -0400 Message-ID: Subject: Re: Zookeeper tries to connect to localhost when i have specified another clearly. To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=047d7b5db26ad829a404e4748a31 X-Virus-Checked: Checked by ClamAV on apache.org --047d7b5db26ad829a404e4748a31 Content-Type: text/plain; charset=UTF-8 Sound correct. You are able to start the shell and scan the few first line of the tables, right? 2013/8/21 Pavan Sudheendra > This is my hbase-site.xml file if it helps: > > > > > > > hbase.rootdir > > > hdfs://ip-10-34-187-170.eu-west-1.compute.internal:8020/hbase > > > hbase.client.write.buffer > 2097152 > > > hbase.client.pause > 1000 > > > hbase.client.retries.number > 10 > > > hbase.client.scanner.caching > 1 > > > hbase.client.keyvalue.maxsize > 10485760 > > > hbase.rpc.timeout > 60000 > > > hbase.security.authentication > simple > > > zookeeper.session.timeout > 60000 > > > zookeeper.znode.parent > /hbase > > > zookeeper.znode.rootserver > root-region-server > > > hbase.zookeeper.quorum > ip-10-34-187-170.eu-west-1.compute.internal > > > hbase.zookeeper.property.clientPort > 2181 > > > > > > On Wed, Aug 21, 2013 at 6:09 PM, Jean-Marc Spaggiari < > jean-marc@spaggiari.org> wrote: > > > Hum. > > > > Things seems to be correct there. > > > > Can you try something simple like: > > > > Configuration config = HBaseConfiguration.create(); > > config.set("hbase.zookeeper.quorum", "ip-10-34-187-170"); > > HTable table = new HTable (config, > > Bytes.toBytes("TABLE_NAME")); > > > > And see if it works? > > > > JM > > > > 2013/8/21 Pavan Sudheendra > > > > > Is this a zookeeper specific error or something? > > > > > > > > > On Wed, Aug 21, 2013 at 6:06 PM, Pavan Sudheendra > > >wrote: > > > > > > > Hi Jean, > > > > > > > > ubuntu@ip-10-34-187-170:~$ cat /etc/hostname > > > > ip-10-34-187-170 > > > > ubuntu@ip-10-34-187-170:~$ hostname > > > > ip-10-34-187-170 > > > > > > > > > > > > > > > > On Wed, Aug 21, 2013 at 6:01 PM, Jean-Marc Spaggiari < > > > > jean-marc@spaggiari.org> wrote: > > > > > > > >> And what about: > > > >> # cat /etc/hostname > > > >> > > > >> and > > > >> # hostname > > > >> > > > >> ? > > > >> > > > >> 2013/8/21 Pavan Sudheendra > > > >> > > > >> > Sure.. > > > >> > /etc/hosts file: > > > >> > > > > >> > 127.0.0.1 localhost > > > >> > 10.34.187.170 ip-10-34-187-170 > > > >> > # The following lines are desirable for IPv6 capable hosts > > > >> > ::1 ip6-localhost ip6-loopback > > > >> > fe00::0 ip6-localnet > > > >> > ff00::0 ip6-mcastprefix > > > >> > ff02::1 ip6-allnodes > > > >> > ff02::2 ip6-allrouters > > > >> > ff02::3 ip6-allhosts > > > >> > > > > >> > Configuration conf = HBaseConfiguration.create(); > > > >> > conf.set("hbase.zookeeper.quorum", "10.34.187.170"); > > > >> > conf.set("hbase.zookeeper.property.clientPort","2181"); > > > >> > conf.set("hbase.master","10.34.187.170"); > > > >> > Job job = new Job(conf, ViewersTable); > > > >> > > > > >> > I'm trying to process table data which has 19 million rows..It > runs > > > fine > > > >> > for a while although i don't see the map percent completion change > > > from > > > >> 0% > > > >> > .. After a while it says > > > >> > > > > >> > Task attempt_201304161625_0028_m_000000_0 failed to report status > > for > > > >> > 600 seconds. Killing! > > > >> > > > > >> > > > > >> > > > > >> > > > > >> > > > > >> > On Wed, Aug 21, 2013 at 5:52 PM, Jean-Marc Spaggiari < > > > >> > jean-marc@spaggiari.org> wrote: > > > >> > > > > >> > > Can you past you host file here again with the modification you > > have > > > >> > done? > > > >> > > > > > >> > > Also, can you share a big more of you code? What are you doing > > with > > > >> the > > > >> > > config object after, how do you create your table object, etc.? > > > >> > > > > > >> > > Thanks, > > > >> > > > > > >> > > JM > > > >> > > > > > >> > > 2013/8/21 Pavan Sudheendra > > > >> > > > > > >> > > > @Jean tried your method didn't work.. > > > >> > > > > > > >> > > > 2013-08-21 12:17:10,908 INFO org.apache.zookeeper.ClientCnxn: > > > >> Opening > > > >> > > > socket connection to server localhost/127.0.0.1:2181. Will > not > > > >> attempt > > > >> > > to > > > >> > > > authenticate using SASL (Unable to locate a login > configuration) > > > >> > > > 2013-08-21 12:17:10,908 WARN org.apache.zookeeper.ClientCnxn: > > > >> Session > > > >> > 0x0 > > > >> > > > for server null, unexpected error, closing socket connection > and > > > >> > > attempting > > > >> > > > reconnect > > > >> > > > java.net.ConnectException: Connection refused > > > >> > > > at sun.nio.ch.SocketChannelImpl.checkConnect(Native > Method) > > > >> > > > at > > > >> > > > > > > >> > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567) > > > >> > > > at > > > >> > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > > > > org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) > > > >> > > > at > > > >> > > > > org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) > > > >> > > > 2013-08-21 12:17:11,009 WARN > > > >> > > > org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: > Possibly > > > >> > > transient > > > >> > > > ZooKeeper exception: > > > >> > > > org.apache.zookeeper.KeeperException$ConnectionLossException: > > > >> > > > KeeperErrorCode = ConnectionLoss for /hbase > > > >> > > > 2013-08-21 12:17:11,009 INFO > > > >> org.apache.hadoop.hbase.util.RetryCounter: > > > >> > > > Sleeping 8000ms before retry #3...\ > > > >> > > > > > > >> > > > Any tips? > > > >> > > > > > > >> > > > > > > >> > > > > > > >> > > > On Wed, Aug 21, 2013 at 5:15 PM, Jean-Marc Spaggiari < > > > >> > > > jean-marc@spaggiari.org> wrote: > > > >> > > > > > > >> > > > > Hi Pavan, > > > >> > > > > > > > >> > > > > I don't think Cloudera Manager assign the address to your > > > >> computer. > > > >> > > When > > > >> > > > CM > > > >> > > > > is down, your computer still have an IP, and even if you > > > >> un-install > > > >> > CM, > > > >> > > > you > > > >> > > > > will still have an IP assigned to your computer. > > > >> > > > > > > > >> > > > > If you have not configured anything there, then you most > > > probably > > > >> > have > > > >> > > a > > > >> > > > > DHCP. Just give a try to what I told you on the other > message. > > > >> > > > > > > > >> > > > > JM > > > >> > > > > > > > >> > > > > 2013/8/21 Pavan Sudheendra > > > >> > > > > > > > >> > > > > > @Manoj i have set hbase.zookeeper.quorum in my M-R > > > application.. > > > >> > > > > > > > > >> > > > > > @Jean The cloudera manager picks up the ip address > > > >> automatically.. > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > On Wed, Aug 21, 2013 at 5:07 PM, manoj p < > eorstvz@gmail.com > > > > > > >> > wrote: > > > >> > > > > > > > > >> > > > > > > Can you try passing the argument > > > >> > > > -Dhbase.zookeeper.quorum=10.34.187.170 > > > >> > > > > > > while running the program > > > >> > > > > > > > > > >> > > > > > > If this does'nt work either please check if HBASE_HOME > and > > > >> > > > > HBASE_CONF_DIR > > > >> > > > > > > is set correctly. > > > >> > > > > > > > > > >> > > > > > > BR/Manoj > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > On Wed, Aug 21, 2013 at 4:48 PM, Pavan Sudheendra < > > > >> > > > pavan0591@gmail.com > > > >> > > > > > > >wrote: > > > >> > > > > > > > > > >> > > > > > > > Yes. My /etc/hosts have the correct mapping to > localhost > > > >> > > > > > > > > > > >> > > > > > > > 127.0.0.1 localhost > > > >> > > > > > > > > > > >> > > > > > > > # The following lines are desirable for IPv6 capable > > hosts > > > >> > > > > > > > ::1 ip6-localhost ip6-loopback > > > >> > > > > > > > fe00::0 ip6-localnet > > > >> > > > > > > > ff00::0 ip6-mcastprefix > > > >> > > > > > > > ff02::1 ip6-allnodes > > > >> > > > > > > > ff02::2 ip6-allrouters > > > >> > > > > > > > > > > >> > > > > > > > I've added the HBase jars to the Hadoop Classpath as > > well. > > > >> Not > > > >> > > sure > > > >> > > > > > why.. > > > >> > > > > > > > I'm running this on a 6 node cloudera cluster which > > > consist > > > >> of > > > >> > 1 > > > >> > > > > > > > jobtrackers and 5 tasktrackers.. > > > >> > > > > > > > > > > >> > > > > > > > After a while all my map jobs fail.. Completely > baffled > > > >> because > > > >> > > the > > > >> > > > > map > > > >> > > > > > > > tasks were doing the required tasks.. > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > On Wed, Aug 21, 2013 at 4:45 PM, manoj p < > > > eorstvz@gmail.com > > > >> > > > > >> > > > wrote: > > > >> > > > > > > > > > > >> > > > > > > > > For your code to run, please ensure if you use the > > > correct > > > >> > > > > > HBase/Hadoop > > > >> > > > > > > > jar > > > >> > > > > > > > > versions while compiling your program. > > > >> > > > > > > > > > > > >> > > > > > > > > BR/Manoj > > > >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > On Wed, Aug 21, 2013 at 4:38 PM, manoj p < > > > >> eorstvz@gmail.com> > > > >> > > > > wrote: > > > >> > > > > > > > > > > > >> > > > > > > > > > Check your /etc/hosts file if you have the correct > > > >> mapping > > > >> > to > > > >> > > > > > > localhost > > > >> > > > > > > > > > for 127.0.0.1. Also ensure that if you have > > > >> > > > > hbase.zookeeper.quorum > > > >> > > > > > in > > > >> > > > > > > > > your > > > >> > > > > > > > > > configuration and also check if HBase classpath is > > > >> appended > > > >> > > to > > > >> > > > > > Hadoop > > > >> > > > > > > > > > classpath. > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > > >> > > > > > > > > > BR/Manoj > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > > >> > > > > > > > > > On Wed, Aug 21, 2013 at 4:10 PM, Pavan Sudheendra > < > > > >> > > > > > > pavan0591@gmail.com > > > >> > > > > > > > > >wrote: > > > >> > > > > > > > > > > > > >> > > > > > > > > >> Hadoop Namenode reports the following error which > > is > > > >> > > unusual : > > > >> > > > > > > > > >> > > > >> > > > > > > > > >> > > > >> > > > > > > > > >> 013-08-21 09:21:12,328 INFO > > > >> > org.apache.zookeeper.ClientCnxn: > > > >> > > > > > Opening > > > >> > > > > > > > > >> socket > > > >> > > > > > > > > >> connection to server localhost/127.0.0.1:2181. > > Will > > > >> not > > > >> > > > attempt > > > >> > > > > > to > > > >> > > > > > > > > >> authenticate using SASL (Unable to locate a login > > > >> > > > configuration) > > > >> > > > > > > > > >> java.net.ConnectException: Connection refused > > > >> > > > > > > > > >> at > > > sun.nio.ch.SocketChannelImpl.checkConnect(Native > > > >> > > > Method) > > > >> > > > > > > > > >> at > > > >> > > > > > > > > >> > > > >> > > > > > > > > > >> > > > > > > >> > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567) > > > >> > > > > > > > > >> at > > > >> > > > > > > > > >> > > > >> > > > > > > > > >> > > > >> > > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > > > > org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) > > > >> > > > > > > > > >> at > > > >> > > > > > > > > >> > > > >> > > > > > > > > >> > > org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) > > > >> > > > > > > > > >> 2013-08-21 09:33:11,033 WARN > > > >> > > > > > > > > >> > > > org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: > > > >> > > > Possibly > > > >> > > > > > > > > transient > > > >> > > > > > > > > >> ZooKeeper exception: > > > >> > > > > > > > > >> > > > >> > > org.apache.zookeeper.KeeperException$ConnectionLossException: > > > >> > > > > > > > > >> KeeperErrorCode = ConnectionLoss for /hbase > > > >> > > > > > > > > >> 2013-08-21 09:33:11,033 INFO > > > >> > > > > > > > org.apache.hadoop.hbase.util.RetryCounter: > > > >> > > > > > > > > >> Sleeping 8000ms before retry #3... > > > >> > > > > > > > > >> 2013-08-21 09:33:11,043 WARN > > > >> > org.apache.hadoop.mapred.Task: > > > >> > > > > Parent > > > >> > > > > > > > died. > > > >> > > > > > > > > >> Exiting attempt_201307181246_0548_m_000022_2 > > > >> > > > > > > > > >> > > > >> > > > > > > > > >> > > > >> > > > > > > > > >> Because i have specified the address in the java > > file > > > >> > > > > > > > > >> Configuration conf = > > HBaseConfiguration.create(); > > > >> > > > > > > > > >> conf.set("hbase.zookeeper.quorum", > > > >> "10.34.187.170"); > > > >> > > > > > > > > >> > > > >> > conf.set("hbase.zookeeper.property.clientPort","2181"); > > > >> > > > > > > > > >> conf.set("hbase.master","10.34.187.170"); > > > >> > > > > > > > > >> > > > >> > > > > > > > > >> > > > >> > > > > > > > > >> > > > >> > > > > > > > > >> All my map tasks fail like this! Please help.. > I'm > > > on a > > > >> > > > timebomb > > > >> > > > > > > > > >> -- > > > >> > > > > > > > > >> Regards- > > > >> > > > > > > > > >> Pavan > > > >> > > > > > > > > >> > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > -- > > > >> > > > > > > > Regards- > > > >> > > > > > > > Pavan > > > >> > > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > -- > > > >> > > > > > Regards- > > > >> > > > > > Pavan > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > >> > > > -- > > > >> > > > Regards- > > > >> > > > Pavan > > > >> > > > > > > >> > > > > > >> > > > > >> > > > > >> > > > > >> > -- > > > >> > Regards- > > > >> > Pavan > > > >> > > > > >> > > > > > > > > > > > > > > > > -- > > > > Regards- > > > > Pavan > > > > > > > > > > > > > > > > -- > > > Regards- > > > Pavan > > > > > > > > > -- > Regards- > Pavan > --047d7b5db26ad829a404e4748a31--