hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Daniel Cryans <jdcry...@apache.org>
Subject Re: Hbase Map Reduce Connection Refused Error
Date Thu, 28 Oct 2010 16:24:23 GMT
>From the log:

2010-10-27 14:28:21,436 INFO org.apache.zookeeper.ClientCnxn: Opening
socket connection to server localhost/127.0.0.1:2181

It tries to connect to localhost:2181, which probably means that your
mapreduce environment isn't pointing to HBase's configuration. This
page should help you a bit:
http://hbase.apache.org/docs/r0.20.6/api/org/apache/hadoop/hbase/mapreduce/package-summary.html#classpath

J-D

On Thu, Oct 28, 2010 at 12:11 AM, Shuja Rehman <shujamughal@gmail.com> wrote:
> Hi All
>
> I am running map reduce job which will dump the data to hbase but when i run
> the job, i am getting the following error message in map task log.
>
> 2010-10-27 14:28:20,486 INFO org.apache.hadoop.util.NativeCodeLoader:
> Loaded the native-hadoop library
> 2010-10-27 14:28:20,813 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
> Initializing JVM Metrics with processName=MAP, sessionId=
> 2010-10-27 14:28:21,406 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:zookeeper.version=3.3.1-942149, built on 05/07/2010 17:14
> GMT
> 2010-10-27 14:28:21,407 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:host.name=app1.hsd1.wa.comcast.net.
> 2010-10-27 14:28:21,407 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:java.version=1.6.0_20
> 2010-10-27 14:28:21,407 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:java.vendor=Sun Microsystems Inc.
> 2010-10-27 14:28:21,407 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.20/jre
> 2010-10-27 14:28:21,407 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:java.class.path=/usr/lib/hadoop-0.20/conf:/usr/lib/jvm/java-6-sun/lib/tools.jar:/usr/lib/hadoop-0.20:/usr/lib/hadoop-0.20/hadoop-core-0.20.2+737.jar:/usr/lib/hadoop-0.20/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop-0.20/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop-0.20/lib/commons-cli-1.2.jar:/usr/lib/hadoop-0.20/lib/commons-codec-1.4.jar:/usr/lib/hadoop-0.20/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop-0.20/lib/commons-el-1.0.jar:/usr/lib/hadoop-0.20/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop-0.20/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop-0.20/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop-0.20/lib/commons-net-1.4.1.jar:/usr/lib/hadoop-0.20/lib/core-3.1.1.jar:/usr/lib/hadoop-0.20/lib/hadoop-fairscheduler-0.20.2+737.jar:/usr/lib/hadoop-0.20/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop-0.20/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop-0.20/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop-0.20/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop-0.20/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop-0.20/lib/jets3t-0.6.1.jar:/usr/lib/hadoop-0.20/lib/jetty-6.1.14.jar:/usr/lib/hadoop-0.20/lib/jetty-util-6.1.14.jar:/usr/lib/hadoop-0.20/lib/junit-4.5.jar:/usr/lib/hadoop-0.20/lib/kfs-0.2.2.jar:/usr/lib/hadoop-0.20/lib/log4j-1.2.15.jar:/usr/lib/hadoop-0.20/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop-0.20/lib/mysql-connector-java-5.0.8-bin.jar:/usr/lib/hadoop-0.20/lib/oro-2.0.8.jar:/usr/lib/hadoop-0.20/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop-0.20/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop-0.20/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop-0.20/lib/xmlenc-0.52.jar:/usr/lib/hadoop-0.20/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop-0.20/lib/jsp-2.1/jsp-api-2.1.jar:/var/lib/hadoop-0.20/cache/mapred/mapred/local/taskTracker/root/jobcache/job_201010191227_0086/jars/classes:/var/lib/hadoop-0.20/cache/mapred/mapred/local/taskTracker/root/jobcache/job_201010191227_0086/jars/job.jar:/var/lib/hadoop-0.20/cache/mapred/mapred/local/taskTracker/root/jobcache/job_201010191227_0086/attempt_201010191227_0086_m_000000_0/work
> 2010-10-27 14:28:21,407 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:java.library.path=/usr/lib/hadoop-0.20/lib/native/Linux-amd64-64:/var/lib/hadoop-0.20/cache/mapred/mapred/local/taskTracker/root/jobcache/job_201010191227_0086/attempt_201010191227_0086_m_000000_0/work
> 2010-10-27 14:28:21,407 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:java.io.tmpdir=/var/lib/hadoop-0.20/cache/mapred/mapred/local/taskTracker/root/jobcache/job_201010191227_0086/attempt_201010191227_0086_m_000000_0/work/tmp
> 2010-10-27 14:28:21,407 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:java.compiler=<NA>
> 2010-10-27 14:28:21,407 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:os.name=Linux
> 2010-10-27 14:28:21,407 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:os.arch=amd64
> 2010-10-27 14:28:21,407 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:os.version=2.6.32-21-server
> 2010-10-27 14:28:21,407 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:user.name=mapred
> 2010-10-27 14:28:21,407 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:user.home=/usr/lib/hadoop-0.20
> 2010-10-27 14:28:21,408 INFO org.apache.zookeeper.ZooKeeper: Client
> environment:user.dir=/var/lib/hadoop-0.20/cache/mapred/mapred/local/taskTracker/root/jobcache/job_201010191227_0086/attempt_201010191227_0086_m_000000_0/work
> 2010-10-27 14:28:21,410 INFO org.apache.zookeeper.ZooKeeper:
> Initiating client connection, connectString=*localhost*:2181
> sessionTimeout=60000
> watcher=org.apache.hadoop.hbase.client.HConnectionManager$ClientZKWatcher@28ab54eb
> 2010-10-27 14:28:21,436 INFO org.apache.zookeeper.ClientCnxn: Opening
> socket connection to server localhost/127.0.0.1:2181
> 2010-10-27 14:28:21,442 WARN org.apache.zookeeper.ClientCnxn: Session
> 0x0 for server null, unexpected error, closing socket connection and
> attempting reconnect
> java.net.ConnectException*: Connection refused*
>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1078)
> 2010-10-27 14:28:22,288 INFO org.apache.zookeeper.ClientCnxn: Opening
> socket connection to server localhost/0:0:0:0:0:0:0:1:2181
> 2010-10-27 14:28:22,289 WARN org.apache.zookeeper.ClientCnxn: Session
> 0x0 for server null, unexpected error, closing socket connection and
> attempting reconnect
> java.net.ConnectException: Connection refused
>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1078)
>
>
> *Here is the output of zookeeper Dump*
>
>
> HBase tree in ZooKeeper is rooted at /hbase
>  Cluster up? true
>  Master address: 10.10.10.2:60000
>  Region server holding ROOT: 10.10.10.4:60020
>  Region servers:
>    - 10.10.10.2:60020
>    - 10.10.10.4:60020
>    - 10.10.10.3:60020
>  Quorum Server Statistics:
>    - 10.10.10.2:2181
>        Zookeeper version: 3.3.1-942149, built on 05/07/2010 17:14 GMT
>        Clients:
>         /10.10.10.2:47228[1](queued=0,recved=5892,sent=5892)
>         /127.0.0.1:42472[1](queued=0,recved=6097,sent=6097)
>         /10.10.10.2:56144[0](queued=0,recved=1,sent=0)
>         /10.10.10.3:39375[1](queued=0,recved=6033,sent=6035)
>         /10.10.10.2:47222[1](queued=0,recved=5925,sent=5928)
>         /10.10.10.2:47233[1](queued=0,recved=5916,sent=5916)
>         /10.10.10.4:54305[1](queued=0,recved=6027,sent=6029)
>
>        Latency min/avg/max: 0/0/35
>        Received: 36898
>        Sent: 36905
>        Outstanding: 0
>        Zxid: 0x28
>        Mode: standalone
>        Node count: 12
>
>
> I assume there is some configuration problem thats why job try to
> connect to local host. Any one has idea how to solve it?
>
> Thanks in advance
>
>
> --
> Regards
> Shuja-ur-Rehman Baig
> http://pk.linkedin.com/in/shujamughal
> Cell: +92 3214207445
>

Mime
View raw message