hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joel Alexandre <joel.alexan...@gmail.com>
Subject Java API ignores config for hbase.zookeeper.quorum and hbase.zookeeper.property.clientPort
Date Sun, 24 Mar 2013 06:37:04 GMT
Hi,

i'm doing a test project with hadoop and hbase. My current cluster has 2
Ubuntu VMs hosted on a windows machine.

Using the Java HBASE API, i can PUT, QUERY and DELETE row remotly (in my
host machine) using

config = HBaseConfiguration.create();
config.set("hbase.zookeeper.quorum", "192.168.56.90");
config.set("hbase.zookeeper.property.clientPort", "2222");

When i tried running a hbase mapreduce job on windows with the same config
as above, i get a

    13/03/24 06:11:03 ERROR security.UserGroupInformation:
PriviledgedActionException as:Joel cause:java.io.IOException: Failed to set
permissions of path: \tmp\hadoop-Joel\mapred\staging\Joel290889388\.staging
to 0700
java.io.IOException: Failed to set permissions of path:
\tmp\hadoop-Joel\mapred\staging\Joel290889388\.staging to 0700

>From what i found in the web, it's a problem o running mapreduce jobs in
windows.

So i tried the mapreduce job in Linux by using "java - jar MR.jar" file.

In linux, i can't connect to zookeeper. For some reason, the zookeeper host
and port are reset in the client

13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Client
environment:os.version=3.5.0-23-generic
13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Client environment:user.name
=hduser
13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Client
environment:user.home=/home/hduser
13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Client
environment:user.dir=/home/hduser/testes
13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=192.168.56.90:2222 sessionTimeout=180000 watcher=hconnection
13/03/24 05:59:33 INFO zookeeper.RecoverableZooKeeper: The identifier of
this process is 11552@node01
13/03/24 05:59:33 INFO zookeeper.ClientCnxn: Opening socket connection to
server node01/*192.168.56.90:2222*. Will not attempt to authenticate using
SASL (unknown error)
13/03/24 05:59:33 INFO zookeeper.ClientCnxn: *Socket connection established
to node01/192.168.56.90:2222, initiating session*
13/03/24 05:59:33 INFO zookeeper.ClientCnxn: *Session establishment
complete on server node01/192.168.56.90:2222*, sessionid =
0x13d9afaa1a30006, negotiated timeout = 180000
13/03/24 05:59:33 INFO client.HConnectionManager$HConnectionImplementation:
Closed zookeeper sessionid=0x13d9afaa1a30006
13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Session: 0x13d9afaa1a30006
closed
13/03/24 05:59:33 INFO zookeeper.ClientCnxn: EventThread shut down
13/03/24 05:59:33 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
13/03/24 05:59:33 WARN mapred.JobClient: Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the same.
13/03/24 05:59:33 INFO zookeeper.ZooKeeper: *Initiating client connection,
connectString=localhost:2181 *sessionTimeout=180000 watcher=hconnection
13/03/24 05:59:33 INFO zookeeper.RecoverableZooKeeper: The identifier of
this process is 11552@node01
13/03/24 05:59:33 INFO zookeeper.ClientCnxn: Opening socket connection to
server localhost/127.0.0.1:2181. Will not attempt to authenticate using
SASL (unknown error)
13/03/24 05:59:33 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
        at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
        at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)

Looking at the above log, it connects correctly to
192.168.56.90:2222(node01 resolves to 192.168.56.90). But for some
reason, it changes to
localhost:2181 and it then gives a connection refused.

How can i fix this to get a MR jobs running in linux, on the same machine
as zookeeper?

versions: Hbase 0.94.5 / hadoop 1.1.2

Thanks.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message