hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Daniel Cryans <jdcry...@apache.org>
Subject Re: org.apache.hadoop.hbase.ZooKeeperConnectionException: org.apache.hadoop.hbase.ZooKeeperConnectionException: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase
Date Thu, 07 Apr 2011 18:39:22 GMT
So regarding finding your logs and other stuff related to that, since
you are using CDH you should always check their documentation.

In ZooKeeper there's a configurable limit of 30 connections per IP.
HTable.close won't close the connection since you can have multiple
HTables using the same cluster. Always make sure you reuse the same
configuration object and always reuse the HTables, don't create new
ones per session or something like that.

This is all described in HTable's class javadoc:
http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/client/HTable.html

J-D

On Thu, Apr 7, 2011 at 11:35 AM, Shuja Rehman <shujamughal@gmail.com> wrote:
> i got the log file and it says that
>
> 2011-04-07 11:17:41,864 - WARN  [NIOServerCxn.Factory:
> 0.0.0.0/0.0.0.0:2181:NIOServerCnxn$Factory@247] - Too many connections from
> /182.178.254.222 - max is 10
> 2011-04-07 11:17:45,453 - WARN  [NIOServerCxn.Factory:
> 0.0.0.0/0.0.0.0:2181:NIOServerCnxn$Factory@247] - Too many connections from
> /182.178.254.222 - max is 10
> 2011-04-07 11:17:47,470 - WARN  [NIOServerCxn.Factory:
> 0.0.0.0/0.0.0.0:2181:NIOServerCnxn$Factory@247] - Too many connections from
> /182.178.254.222 - max is 10
> 2011-04-07 11:17:49,964 - WARN  [NIOServerCxn.Factory:
> 0.0.0.0/0.0.0.0:2181:NIOServerCnxn$Factory@247] - Too many connections from
> /182.178.254.222 - max is 10
> 2011-04-07 11:17:52,101 - WARN  [NIOServerCxn.Factory:
> 0.0.0.0/0.0.0.0:2181:NIOServerCnxn$Factory@247] - Too many connections from
> /182.178.254.222 - max is 10
> 2011-04-07 11:17:54,211 - WARN  [NIOServerCxn.Factory:
> 0.0.0.0/0.0.0.0:2181:NIOServerCnxn$Factory@247] - Too many connections from
> /182.178.254.222 - max is 10
> 2011-04-07 11:17:54,251 - WARN  [NIOServerCxn.Factory:
> 0.0.0.0/0.0.0.0:2181:NIOServerCnxn@639] - Exception causing close of session
> 0x12f30d63bc90013 due to java.io.IOException: Connection reset by peer
> 2011-04-07 11:17:54,251 - INFO  [NIOServerCxn.Factory:
> 0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1435] - Closed socket connection for
> client /182.178.254.222:27546 which had sessionid 0x12f30d63bc90013
> 2011-04-07 11:18:24,004 - INFO  [SessionTracker:ZooKeeperServer@314] -
> Expiring session 0x12f30d63bc90013, timeout of 40000ms exceeded
> 2011-04-07 11:18:24,005 - INFO  [ProcessThread:-1:PrepRequestProcessor@387]
> - Processed session termination for sessionid: 0x12f30d63bc90013
>
>
> so how to close the connection? i am also using now htable.close() in the
> end of funtion.
>
> On Thu, Apr 7, 2011 at 11:21 PM, Shuja Rehman <shujamughal@gmail.com> wrote:
>
>> where zookeeper keeps its logs? i check the /usr/lib/zookeeper and there is
>> no log file inside. also not in bin folder.
>>
>>
>>
>>
>> On Thu, Apr 7, 2011 at 11:17 PM, Jean-Daniel Cryans <jdcryans@apache.org>wrote:
>>
>>> If you look at 204.13.166.85's zookeeper log, do you see anything that
>>> looks bad around the time you ran this?
>>>
>>> J-D
>>>
>>> On Thu, Apr 7, 2011 at 11:04 AM, Shuja Rehman <shujamughal@gmail.com>
>>> wrote:
>>> > here is more log. now it is not connecting at all.
>>> >
>>> > 11/04/07 23:02:55 WARN hbase.HBaseConfiguration: instantiating
>>> > HBaseConfiguration() is deprecated. Please use
>>> HBaseConfiguration#create()
>>> > to construct a plain Configuration
>>> > 11/04/07 23:02:55 INFO zookeeper.ZooKeeper: Client
>>> > environment:zookeeper.version=3.3.2-CDH3B4--1, built on 02/21/2011 22:45
>>> GMT
>>> > 11/04/07 23:02:55 INFO zookeeper.ZooKeeper: Client environment:
>>> host.name=DV
>>> > 11/04/07 23:02:55 INFO zookeeper.ZooKeeper: Client
>>> > environment:java.version=1.6.0_21
>>> > 11/04/07 23:02:55 INFO zookeeper.ZooKeeper: Client
>>> > environment:java.vendor=Sun Microsystems Inc.
>>> > 11/04/07 23:02:55 INFO zookeeper.ZooKeeper: Client
>>> > environment:java.home=C:\Program Files\Java\jdk1.6.0_21\jre
>>> > 11/04/07 23:02:55 INFO zookeeper.ZooKeeper: Client
>>> >
>>> environment:java.class.path=D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\build\web\WEB-INF\classes;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\CopyLibs\commons-logging-1.1.1.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\CopyLibs\log4j-1.2.15.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\metro\activation.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\metro\webservices-api.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\metro\webservices-extra-api.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\metro\webservices-extra.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\metro\webservices-rt.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\metro\webservices-tools.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\restapi\jsr311-api-1.1.1.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\restlib\asm-3.1.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\restlib\jackson-core-asl-1.1.1.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\restlib\jersey-client-1.1.5.1.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\restlib\jersey-core-1.1.5.1.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\restlib\jersey-json-1.1.5.1.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\restlib\jersey-server-1.1.5.1.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\restlib\jersey-spring-1.1.5.1.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\restlib\jettison-1.1.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\restlib\oauth-client-1.1.5.1.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\restlib\oauth-signature-1.1.5.1.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\restlib\activation.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\restlib\jaxb-api.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\restlib\jsr173_api.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\CopyLibs\hadoop-0.20.2-CDH3B4-core.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\CopyLibs\hbase-0.90.1-CDH3B4.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\CopyLibs\mysql-connector-java-5.1.7-bin.jar;D:\FreeLauncing\DataWareHouse\UIDataTransporter\dist\UIDataTransporter.jar;D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn\lib\CopyLibs\zookeeper-3.3.2-CDH3B4.jar;C:\Program
>>> > Files\Apache Software Foundation\Apache Tomcat
>>> > 6.0.26\lib\annotations-api.jar;C:\Program Files\Apache Software
>>> > Foundation\Apache Tomcat 6.0.26\lib\catalina-ant.jar;C:\Program
>>> Files\Apache
>>> > Software Foundation\Apache Tomcat 6.0.26\lib\catalina-ha.jar;C:\Program
>>> > Files\Apache Software Foundation\Apache Tomcat
>>> > 6.0.26\lib\catalina-tribes.jar;C:\Program Files\Apache Software
>>> > Foundation\Apache Tomcat 6.0.26\lib\catalina.jar;C:\Program Files\Apache
>>> > Software Foundation\Apache Tomcat 6.0.26\lib\el-api.jar;C:\Program
>>> > Files\Apache Software Foundation\Apache Tomcat
>>> > 6.0.26\lib\jasper-el.jar;C:\Program Files\Apache Software
>>> Foundation\Apache
>>> > Tomcat 6.0.26\lib\jasper.jar;C:\Program Files\Apache Software
>>> > Foundation\Apache Tomcat 6.0.26\lib\jsp-api.jar;C:\Program Files\Apache
>>> > Software Foundation\Apache Tomcat 6.0.26\lib\servlet-api.jar;C:\Program
>>> > Files\Apache Software Foundation\Apache Tomcat
>>> > 6.0.26\lib\tomcat-coyote.jar;C:\Program Files\Apache Software
>>> > Foundation\Apache Tomcat 6.0.26\lib\tomcat-dbcp.jar;C:\Program
>>> Files\Apache
>>> > Software Foundation\Apache Tomcat
>>> 6.0.26\lib\tomcat-i18n-es.jar;C:\Program
>>> > Files\Apache Software Foundation\Apache Tomcat
>>> > 6.0.26\lib\tomcat-i18n-fr.jar;C:\Program Files\Apache Software
>>> > Foundation\Apache Tomcat 6.0.26\lib\tomcat-i18n-ja.jar;C:\Program
>>> > Files\Apache Software Foundation\Apache Tomcat
>>> 6.0.26\bin\tomcat-juli.jar
>>> > 11/04/07 23:02:55 INFO zookeeper.ZooKeeper: Client
>>> > environment:java.library.path=C:\Program
>>> >
>>> Files\Java\jdk1.6.0_21\jre\bin;.;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;C:\Program
>>> > Files\Common Files\Microsoft Shared\Windows Live;C:\Program Files\PC
>>> > Connectivity
>>> >
>>> Solution\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;c:\Program
>>> > Files\Microsoft SQL Server\90\Tools\binn\;C:\Program
>>> > Files\TortoiseSVN\bin;C:\Program Files\Microsoft SQL
>>> > Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL
>>> > Server\100\DTS\Binn\;C:\Program Files\Microsoft SQL
>>> > Server\100\Tools\Binn\VSShell\Common7\IDE\;C:\Program Files\Microsoft
>>> Visual
>>> > Studio 9.0\Common7\IDE\PrivateAssemblies\;C:\Program Files\Windows
>>> > Live\Shared;C:\Program Files\K-Lite Codec
>>> > Pack\QuickTime\QTSystem\;D:\cygwin\bin
>>> > 11/04/07 23:02:56 INFO zookeeper.ZooKeeper: Client
>>> > environment:java.io.tmpdir=C:\Users\shuja\AppData\Local\Temp\
>>> > 11/04/07 23:02:56 INFO zookeeper.ZooKeeper: Client
>>> > environment:java.compiler=<NA>
>>> > 11/04/07 23:02:56 INFO zookeeper.ZooKeeper: Client environment:os.name
>>> =Windows
>>> > 7
>>> > 11/04/07 23:02:56 INFO zookeeper.ZooKeeper: Client
>>> environment:os.arch=x86
>>> > 11/04/07 23:02:56 INFO zookeeper.ZooKeeper: Client
>>> > environment:os.version=6.1
>>> > 11/04/07 23:02:56 INFO zookeeper.ZooKeeper: Client environment:
>>> user.name
>>> > =shuja
>>> > 11/04/07 23:02:56 INFO zookeeper.ZooKeeper: Client
>>> > environment:user.home=C:\Users\shuja
>>> > 11/04/07 23:02:56 INFO zookeeper.ZooKeeper: Client
>>> >
>>> environment:user.dir=D:\FreeLauncing\DataWareHouse\WebServices\WebServiceSvn
>>> > 11/04/07 23:02:56 INFO zookeeper.ZooKeeper: Initiating client
>>> connection,
>>> > connectString=204.13.166.85:2181 sessionTimeout=180000
>>> watcher=hconnection
>>> > 11/04/07 23:02:56 INFO zookeeper.ClientCnxn: Opening socket connection
>>> to
>>> > server /204.13.166.85:2181
>>> > 11/04/07 23:03:01 INFO zookeeper.ClientCnxn: Socket connection
>>> established
>>> > to 204.13.166.85/204.13.166.85:2181, initiating session
>>> > 11/04/07 23:03:01 INFO zookeeper.ClientCnxn: Unable to read additional
>>> data
>>> > from server sessionid 0x0, likely server has closed socket, closing
>>> socket
>>> > connection and attempting reconnect
>>> > 11/04/07 23:03:03 INFO zookeeper.ClientCnxn: Opening socket connection
>>> to
>>> > server 204.13.166.85/204.13.166.85:2181
>>> > 11/04/07 23:03:03 INFO zookeeper.ClientCnxn: Socket connection
>>> established
>>> > to 204.13.166.85/204.13.166.85:2181, initiating session
>>> > 11/04/07 23:03:03 INFO zookeeper.ClientCnxn: Unable to read additional
>>> data
>>> > from server sessionid 0x0, likely server has closed socket, closing
>>> socket
>>> > connection and attempting reconnect
>>> > 11/04/07 23:03:05 INFO zookeeper.ClientCnxn: Opening socket connection
>>> to
>>> > server 204.13.166.85/204.13.166.85:2181
>>> > 11/04/07 23:03:05 INFO zookeeper.ClientCnxn: Socket connection
>>> established
>>> > to 204.13.166.85/204.13.166.85:2181, initiating session
>>> > 11/04/07 23:03:05 INFO zookeeper.ClientCnxn: Unable to read additional
>>> data
>>> > from server sessionid 0x0, likely server has closed socket, closing
>>> socket
>>> > connection and attempting reconnect
>>> > 11/04/07 23:03:07 INFO zookeeper.ClientCnxn: Opening socket connection
>>> to
>>> > server 204.13.166.85/204.13.166.85:2181
>>> > 11/04/07 23:03:07 INFO zookeeper.ClientCnxn: Socket connection
>>> established
>>> > to 204.13.166.85/204.13.166.85:2181, initiating session
>>> > 11/04/07 23:03:08 INFO zookeeper.ClientCnxn: Unable to read additional
>>> data
>>> > from server sessionid 0x0, likely server has closed socket, closing
>>> socket
>>> > connection and attempting reconnect
>>> > 07-Apr-2011 23:03:08 DAO.AbstractDAO connect
>>> > SEVERE: null
>>> > org.apache.hadoop.hbase.ZooKeeperConnectionException:
>>> > org.apache.hadoop.hbase.ZooKeeperConnectionException:
>>> > org.apache.zookeeper.KeeperException$ConnectionLossException:
>>> > KeeperErrorCode = ConnectionLoss for /hbase
>>> >        at
>>> >
>>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:988)
>>> >        at
>>> >
>>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:301)
>>> >        at
>>> >
>>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:292)
>>> >        at
>>> >
>>> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:155)
>>> >        at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:167)
>>> >        at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:145)
>>> >        at DAO.AbstractDAO.connect(AbstractDAO.java:31)
>>> >        at DAO.TimeWindowDAO.getTimeWindowReport(TimeWindowDAO.java:132)
>>> >
>>> > On Thu, Apr 7, 2011 at 10:27 PM, Jean-Daniel Cryans <
>>> jdcryans@apache.org>wrote:
>>> >
>>> >> You should be seeing more log lines related to ZooKeeper before that.
>>> >>
>>> >> Also make sure your client connects to the zk server.
>>> >>
>>> >> J-D
>>> >>
>>> >> On Thu, Apr 7, 2011 at 9:11 AM, Shuja Rehman <shujamughal@gmail.com>
>>> >> wrote:
>>> >> > Hi
>>> >> >
>>> >> > I am trying to read from hbase the following code.
>>> >> >
>>> >> > http://pastebin.com/wvVVUT3p
>>> >> >
>>> >> > it reads for first 4-5 times but after that it start throwing this
>>> >> exception
>>> >> >
>>> >> > SEVERE: null
>>> >> > org.apache.hadoop.hbase.ZooKeeperConnectionException:
>>> >> > org.apache.hadoop.hbase.ZooKeeperConnectionException:
>>> >> > org.apache.zookeeper.KeeperException$ConnectionLossException:
>>> >> > KeeperErrorCode = ConnectionLoss for /hbase
>>> >> >        at
>>> >> >
>>> >>
>>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:988)
>>> >> >        at
>>> >> >
>>> >>
>>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:301)
>>> >> >        at org.apache.hadoop.hbase.client.HConnectionManager$HCo
>>> >> >
>>> >> >
>>> >> > The full details of exception are here.
>>> >> >
>>> >> > http://pastebin.com/Yj4VgvHG
>>> >> >
>>> >> > I am using CDH3b4 in pseudo enviornment.
>>> >> >
>>> >> > Any clue???
>>> >> > thnx
>>> >> >
>>> >> > --
>>> >> > Regards
>>> >> > Shuja-ur-Rehman Baig
>>> >> > <http://pk.linkedin.com/in/shujamughal>
>>> >> >
>>> >>
>>> >
>>> >
>>> >
>>> > --
>>> > Regards
>>> > Shuja-ur-Rehman Baig
>>> > <http://pk.linkedin.com/in/shujamughal>
>>> >
>>>
>>
>>
>>
>> --
>> Regards
>> Shuja-ur-Rehman Baig
>> <http://pk.linkedin.com/in/shujamughal>
>>
>>
>
>
> --
> Regards
> Shuja-ur-Rehman Baig
> <http://pk.linkedin.com/in/shujamughal>
>

Mime
View raw message