Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 79F08F3F4 for ; Sun, 24 Mar 2013 13:59:08 +0000 (UTC) Received: (qmail 34971 invoked by uid 500); 24 Mar 2013 13:59:06 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 34923 invoked by uid 500); 24 Mar 2013 13:59:05 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 34914 invoked by uid 99); 24 Mar 2013 13:59:05 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 24 Mar 2013 13:59:05 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of yuzhihong@gmail.com designates 209.85.215.51 as permitted sender) Received: from [209.85.215.51] (HELO mail-la0-f51.google.com) (209.85.215.51) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 24 Mar 2013 13:59:01 +0000 Received: by mail-la0-f51.google.com with SMTP id fo13so9665973lab.24 for ; Sun, 24 Mar 2013 06:58:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=V4unMtK0qgofZwOY97PLSlFfihs+fgUwS8kIy6xiziY=; b=tA3TW9JEKN0dO9BNlR/180EWpSYGgLxJ2TlPmPYcv/D3Ss0pDfS84Wd6DhPgX87DiG qytajGa963xDe8IVHhqlcXLYjvBNhlhnKYFOdN0giZejC2zjBjh7DTUy74/PotmaAPSz xcGReoKQCCR9io69IbIp1wFbkjSkqmqmhxhUbXdHC/lDtQQi4hHuhHBrIevoeGuGgIAB LAxWNMaQ6RTv8bQvdgX2xTu4RwghZ+R/Gc1M+MuamVuTHdWoo/BoVDPcvkYdkYh71Lbg eQg+CbvmB8mQ5LVnZDwtrp+LlbA6Ibg3ePfM5NaQlptfV33fqGmXHGd7kr5Z51D/tmmj 5uWQ== MIME-Version: 1.0 X-Received: by 10.152.133.52 with SMTP id oz20mr4265168lab.30.1364133519095; Sun, 24 Mar 2013 06:58:39 -0700 (PDT) Received: by 10.112.84.133 with HTTP; Sun, 24 Mar 2013 06:58:38 -0700 (PDT) In-Reply-To: References: Date: Sun, 24 Mar 2013 06:58:38 -0700 Message-ID: Subject: Re: Java API ignores config for hbase.zookeeper.quorum and hbase.zookeeper.property.clientPort From: Ted Yu To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=f46d0435c24cd4fe0404d8ac158c X-Virus-Checked: Checked by ClamAV on apache.org --f46d0435c24cd4fe0404d8ac158c Content-Type: text/plain; charset=ISO-8859-1 To pick up zookeeper setting (and others), prefix your command line with: `$HBASE_HOME/bin/hbase classpath` Cheers On Sat, Mar 23, 2013 at 11:37 PM, Joel Alexandre wrote: > Hi, > > i'm doing a test project with hadoop and hbase. My current cluster has 2 > Ubuntu VMs hosted on a windows machine. > > Using the Java HBASE API, i can PUT, QUERY and DELETE row remotly (in my > host machine) using > > config = HBaseConfiguration.create(); > config.set("hbase.zookeeper.quorum", "192.168.56.90"); > config.set("hbase.zookeeper.property.clientPort", "2222"); > > When i tried running a hbase mapreduce job on windows with the same config > as above, i get a > > 13/03/24 06:11:03 ERROR security.UserGroupInformation: > PriviledgedActionException as:Joel cause:java.io.IOException: Failed to set > permissions of path: \tmp\hadoop-Joel\mapred\staging\Joel290889388\.staging > to 0700 > java.io.IOException: Failed to set permissions of path: > \tmp\hadoop-Joel\mapred\staging\Joel290889388\.staging to 0700 > > From what i found in the web, it's a problem o running mapreduce jobs in > windows. > > So i tried the mapreduce job in Linux by using "java - jar MR.jar" file. > > In linux, i can't connect to zookeeper. For some reason, the zookeeper host > and port are reset in the client > > 13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Client > environment:os.version=3.5.0-23-generic > 13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Client environment:user.name > =hduser > 13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Client > environment:user.home=/home/hduser > 13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Client > environment:user.dir=/home/hduser/testes > 13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Initiating client connection, > connectString=192.168.56.90:2222 sessionTimeout=180000 watcher=hconnection > 13/03/24 05:59:33 INFO zookeeper.RecoverableZooKeeper: The identifier of > this process is 11552@node01 > 13/03/24 05:59:33 INFO zookeeper.ClientCnxn: Opening socket connection to > server node01/*192.168.56.90:2222*. Will not attempt to authenticate using > SASL (unknown error) > 13/03/24 05:59:33 INFO zookeeper.ClientCnxn: *Socket connection established > to node01/192.168.56.90:2222, initiating session* > 13/03/24 05:59:33 INFO zookeeper.ClientCnxn: *Session establishment > complete on server node01/192.168.56.90:2222*, sessionid = > 0x13d9afaa1a30006, negotiated timeout = 180000 > 13/03/24 05:59:33 INFO client.HConnectionManager$HConnectionImplementation: > Closed zookeeper sessionid=0x13d9afaa1a30006 > 13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Session: 0x13d9afaa1a30006 > closed > 13/03/24 05:59:33 INFO zookeeper.ClientCnxn: EventThread shut down > 13/03/24 05:59:33 WARN util.NativeCodeLoader: Unable to load native-hadoop > library for your platform... using builtin-java classes where applicable > 13/03/24 05:59:33 WARN mapred.JobClient: Use GenericOptionsParser for > parsing the arguments. Applications should implement Tool for the same. > 13/03/24 05:59:33 INFO zookeeper.ZooKeeper: *Initiating client connection, > connectString=localhost:2181 *sessionTimeout=180000 watcher=hconnection > 13/03/24 05:59:33 INFO zookeeper.RecoverableZooKeeper: The identifier of > this process is 11552@node01 > 13/03/24 05:59:33 INFO zookeeper.ClientCnxn: Opening socket connection to > server localhost/127.0.0.1:2181. Will not attempt to authenticate using > SASL (unknown error) > 13/03/24 05:59:33 WARN zookeeper.ClientCnxn: Session 0x0 for server null, > unexpected error, closing socket connection and attempting reconnect > java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > at > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) > at > > org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) > > Looking at the above log, it connects correctly to > 192.168.56.90:2222(node01 resolves to 192.168.56.90). But for some > reason, it changes to > localhost:2181 and it then gives a connection refused. > > How can i fix this to get a MR jobs running in linux, on the same machine > as zookeeper? > > versions: Hbase 0.94.5 / hadoop 1.1.2 > > Thanks. > --f46d0435c24cd4fe0404d8ac158c--