hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alaukik Aggarwal <alaukik.aggar...@gmail.com>
Subject Re: Problem in Running HBase in Pseudo Distributed Mode
Date Thu, 18 Nov 2010 00:44:48 GMT
I have turned distributed flag to true, but still the problem persists ...

Following are the recent logs of Zookeeper

010-11-17 18:39:26,029 INFO
org.apache.zookeeper.server.ZooKeeperServerMain: Starting server
2010-11-17 18:39:26,071 INFO
org.apache.zookeeper.server.ZooKeeperServer: Server
environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51
GMT
2010-11-17 18:39:26,072 INFO
org.apache.zookeeper.server.ZooKeeperServer: Server
environment:host.name=alaukik
2010-11-17 18:39:26,072 INFO
org.apache.zookeeper.server.ZooKeeperServer: Server
environment:java.version=1.6.0_22
2010-11-17 18:39:26,072 INFO
org.apache.zookeeper.server.ZooKeeperServer: Server
environment:java.vendor=Sun Microsystems Inc.
2010-11-17 18:39:26,072 INFO
org.apache.zookeeper.server.ZooKeeperServer: Server
environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.22/jre
2010-11-17 18:39:26,072 INFO
org.apache.zookeeper.server.ZooKeeperServer: Server
environment:java.class.path=/home/alaukik/Documents/hbase-0.20.6/bin/../conf:/usr/lib/jvm/java-6-sun-1.6.0.22//lib/tools.jar:/home/alaukik/Documents/hbase-0.20.6/bin/..:/home/alaukik/Documents/hbase-0.20.6/bin/../hbase-0.20.6.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../hbase-0.20.6-test.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/commons-cli-2.0-SNAPSHOT.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/commons-el-from-jetty-5.1.4.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/commons-httpclient-3.0.1.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/commons-logging-1.0.4.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/commons-logging-api-1.0.4.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/commons-math-1.1.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/hadoop-0.20.2-core.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/hadoop-0.20.2-test.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/jasper-compiler-5.5.12.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/jasper-runtime-5.5.12.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/jetty-6.1.14.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/jetty-util-6.1.14.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/jruby-complete-1.2.0.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/junit-4.8.1.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/libthrift-r771587.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/log4j-1.2.15.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/lucene-core-2.2.0.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/servlet-api-2.5-6.1.14.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/xmlenc-0.52.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/zookeeper-3.2.2.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/jsp-2.1/jsp-2.1.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/jsp-2.1/jsp-api-2.1.jar
2010-11-17 18:39:26,072 INFO
org.apache.zookeeper.server.ZooKeeperServer: Server
environment:java.library.path=/home/alaukik/Documents/hbase-0.20.6/bin/../lib/native/Linux-i386-32
2010-11-17 18:39:26,072 INFO
org.apache.zookeeper.server.ZooKeeperServer: Server
environment:java.io.tmpdir=/tmp
2010-11-17 18:39:26,072 INFO
org.apache.zookeeper.server.ZooKeeperServer: Server
environment:java.compiler=<NA>
2010-11-17 18:39:26,072 INFO
org.apache.zookeeper.server.ZooKeeperServer: Server
environment:os.name=Linux
2010-11-17 18:39:26,072 INFO
org.apache.zookeeper.server.ZooKeeperServer: Server
environment:os.arch=i386
2010-11-17 18:39:26,073 INFO
org.apache.zookeeper.server.ZooKeeperServer: Server
environment:os.version=2.6.32-25-generic
2010-11-17 18:39:26,073 INFO
org.apache.zookeeper.server.ZooKeeperServer: Server
environment:user.name=alaukik
2010-11-17 18:39:26,073 INFO
org.apache.zookeeper.server.ZooKeeperServer: Server
environment:user.home=/home/alaukik
2010-11-17 18:39:26,073 INFO
org.apache.zookeeper.server.ZooKeeperServer: Server
environment:user.dir=/home/alaukik/Documents/hbase-0.20.6
2010-11-17 18:39:26,223 INFO
org.apache.zookeeper.server.persistence.FileSnap: Reading snapshot
/tmp/hbase-alaukik/zookeeper/version-2/snapshot.0
2010-11-17 18:39:26,298 INFO
org.apache.zookeeper.server.persistence.FileTxnSnapLog: Snapshotting:
1
2010-11-17 18:39:27,323 INFO
org.apache.zookeeper.server.NIOServerCnxn: Connected to
/127.0.0.1:48375 lastZxid 1
2010-11-17 18:39:27,331 INFO
org.apache.zookeeper.server.NIOServerCnxn: Finished init of
0x12c5c32002c0000 valid:true
2010-11-17 18:39:27,331 INFO
org.apache.zookeeper.server.NIOServerCnxn: Renewing session
0x12c5c32002c0000
Wed Nov 17 18:40:51 EST 2010 Stopping zookeeper
Wed Nov 17 18:40:51 EST 2010 Killing zookeeper


On Wed, Nov 17, 2010 at 6:03 PM, Buttler, David <buttler1@llnl.gov> wrote:
> I believe that you should have turned the distributed flag to true.  Also, you should
check your zookeeper to see if the master had successfully registered there.
>
> Dave
>
> -----Original Message-----
> From: Alaukik Aggarwal [mailto:alaukik.aggarwal@gmail.com]
> Sent: Wednesday, November 17, 2010 1:34 PM
> To: user@hbase.apache.org
> Subject: Re: Problem in Running HBase in Pseudo Distributed Mode
>
> Please... any suggestions ??
>
>
> On Wed, Nov 17, 2010 at 12:36 PM, Alaukik Aggarwal
> <alaukik.aggarwal@gmail.com> wrote:
>> I tried this. I waited for 5 min before executing list command on shell.
>>
>> Also,there was no log in HMaster logs when this exception (ERROR:
>> org.apache.hadoop.hbase.MasterNotRunningException: null) was thrown
>> while accessing through HBase shell.
>>
>>
>>
>> On Wed, Nov 17, 2010 at 3:12 AM, Hari Sreekumar
>> <hsreekumar@clickable.com> wrote:
>>> It seems to be all right. How long do you wait after starting HBase before
>>> trying to list? Wait 5 mins after starting the daemons before listing. Did
>>> you try list after checking the master log (the one you have uploaded here)
>>> ? You could also try using localhost instead of the hostname in the conf
>>> files. Let me know..
>>>
>>> hari
>>>
>>> On Wed, Nov 17, 2010 at 12:57 PM, Alaukik Aggarwal <
>>> alaukik.aggarwal@gmail.com> wrote:
>>>
>>>> $ bin/hadoop fs -ls /
>>>> Found 2 items
>>>> drwxr-xr-x   - alaukik supergroup          0 2010-11-16 23:28 /hbase
>>>> drwxr-xr-x   - alaukik supergroup          0 2010-11-16 23:17 /tmp
>>>>
>>>> $ bin/hadoop fs -ls /hbase
>>>> Found 4 items
>>>> drwxr-xr-x   - alaukik supergroup          0 2010-11-16 23:26 /hbase/-ROOT-
>>>> drwxr-xr-x   - alaukik supergroup          0 2010-11-16 23:17 /hbase/.META.
>>>> drwxr-xr-x   - alaukik supergroup          0 2010-11-16 23:39 /hbase/.logs
>>>> -rw-r--r--   3 alaukik supergroup          3 2010-11-16 23:17
>>>> /hbase/hbase.version
>>>>
>>>> This also seems to fine.
>>>>
>>>> What could be the reason? :S
>>>>
>>>> Also, when does HMaster give the following in its Log:
>>>> Failed to read: org.apache.zookeeper.KeeperException$NoNodeException:
>>>> KeeperErrorCode = NoNode for /hbase/master
>>>>
>>>> Alaukik
>>>>
>>>>
>>>> On Wed, Nov 17, 2010 at 2:03 AM, Hari Sreekumar
>>>> <hsreekumar@clickable.com> wrote:
>>>> > No, for pseudo distributed mode, you shouldn't set
>>>> hbase.cluster.distributed
>>>> > to true. /etc/hosts seems to be fine. And HMaster is running fine as
per
>>>> the
>>>> > log file. Did you try browsing root in HDFS? (dfs -ls /). Has a directory
>>>> > named hbase been created automatically? Does it contain anything?
>>>> >
>>>> > On Wed, Nov 17, 2010 at 11:06 AM, Alaukik Aggarwal <
>>>> > alaukik.aggarwal@gmail.com> wrote:
>>>> >
>>>> >> Thanks for your quick reply.
>>>> >>
>>>> >> $ cat /etc/hosts
>>>> >> 127.0.0.1       localhost
>>>> >> 192.168.1.2     alaukik
>>>> >>
>>>> >> # The following lines are desirable for IPv6 capable hosts
>>>> >> ::1     localhost ip6-localhost ip6-loopback
>>>> >> fe00::0 ip6-localnet
>>>> >> ff00::0 ip6-mcastprefix
>>>> >> ff02::1 ip6-allnodes
>>>> >> ff02::2 ip6-allrouters
>>>> >> ff02::3 ip6-allhosts
>>>> >>
>>>> >>
>>>> >> My OS is Ubuntu 10.04.1.
>>>> >>
>>>> >> In regionservers.log:
>>>> >> Tue Nov 16 23:38:54 EST 2010 Starting regionserver on alaukik
>>>> >> ulimit -n 1024
>>>> >> 2010-11-16 23:38:55,706 WARN
>>>> >> org.apache.hadoop.hbase.regionserver.HRegionServer: Not starting
a
>>>> >> distinct region server because hbase.cluster.distributed is false
>>>> >>
>>>> >> Should we set distributed as true?
>>>> >> I am trying to run this in pseudo-distributed mode. And on HBase
site,
>>>> >> it is mentioned that this is set true only in distributed mode.
>>>> >>
>>>> >> Alaukik
>>>> >>
>>>> >>
>>>> >>
>>>> >> On Wed, Nov 17, 2010 at 12:00 AM, Hari Sreekumar
>>>> >> <hsreekumar@clickable.com> wrote:
>>>> >> > Hi,
>>>> >> >   hmm... It seems HRegionServer is unable to start because
it doesn't
>>>> see
>>>> >> > the HMaster at 192.168.1.2:60000. Can you post your /etc/hosts
file?
>>>> >> There
>>>> >> > might be issues with the wrong IP being reported. What is your
OS?
>>>> >> >
>>>> >> > hari
>>>> >> >
>>>> >> > On Wed, Nov 17, 2010 at 10:21 AM, Alaukik Aggarwal <
>>>> >> > alaukik.aggarwal@gmail.com> wrote:
>>>> >> >
>>>> >> >> Hi,
>>>> >> >>
>>>> >> >> I am running HBase configured in Pseudo-distributed mode
(Hadoop also
>>>> >> >> in Pseudo Distributed mode)
>>>> >> >> Hadoop version: 0.20.2
>>>> >> >> HBase version: 0.20.6
>>>> >> >>
>>>> >> >> On running any command (for instance, list) in HBase shell,
it gives
>>>> me:
>>>> >> >> ERROR: org.apache.hadoop.hbase.MasterNotRunningException:
null
>>>> >> >>
>>>> >> >> I can see master running at: http://BLOCKEDalaukik:60010/master.jsp
>>>> >> >> (Similarly, I can also see namenode running in Web UI).
>>>> >> >>
>>>> >> >> On jps, I get all the required processes running:
>>>> >> >>
>>>> >> >> $ jps
>>>> >> >> 9513 HQuorumPeer
>>>> >> >> 9259 TaskTracker
>>>> >> >> 9099 JobTracker
>>>> >> >> 9771 Jps
>>>> >> >> 8677 NameNode
>>>> >> >> 9572 HMaster
>>>> >> >> 9019 SecondaryNameNode
>>>> >> >> 8848 DataNode
>>>> >> >>
>>>> >> >> I have attached a fresh log of hbase-master and my hbase-site.xml
>>>> file.
>>>> >> >>
>>>> >> >> I cannot see any exception in the log, except a Failed
notification:
>>>> >> >> Failed to read: org.apache.zookeeper.KeeperException$NoNodeException:
>>>> >> >> KeeperErrorCode = NoNode for /hbase/master
>>>> >> >>
>>>> >> >> Also if I try to access HBase through Java client (exact
sample code
>>>> >> >> given on apache HBase site), I get the follwoing output:
>>>> >> >> 10/11/16 23:46:29 WARN hbase.HBaseConfiguration: instantiating
>>>> >> >> HBaseConfiguration() is deprecated. Please use
>>>> >> >> HBaseConfiguration#create() to construct a plain Configuration
>>>> >> >> 2
>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeperWrapper: Reconnecting
to
>>>> >> >> zookeeper
>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>> >> >> environment:zookeeper.version=3.3.1-942149, built on 05/07/2010
17:14
>>>> >> >> GMT
>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client environment:
>>>> >> host.name
>>>> >> >> =alaukik
>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>> >> >> environment:java.version=1.6.0_22
>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>> >> >> environment:java.vendor=Sun Microsystems Inc.
>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>> >> >> environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.22/jre
>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>> >> >> environment:java.class.path=/home/.............log4j-1.2.15.jar
>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>> >> >>
>>>> >> >>
>>>> >>
>>>> environment:java.library.path=/usr/lib/jvm/java-6-sun-1.6.0.22/jre/lib/i386/server:/usr/lib/jvm/java-6-sun-1.6.0.22/jre/lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.22/jre/../lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.22/jre/lib/i386/client:/usr/lib/jvm/java-6-sun-1.6.0.22/jre/lib/i386:/usr/lib/xulrunner-addons:/usr/lib/xulrunner-addons:/usr/java/packages/lib/i386:/lib:/usr/lib
>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>> >> >> environment:java.io.tmpdir=/tmp
>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>> >> >> environment:java.compiler=<NA>
>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client environment:
>>>> os.name
>>>> >> >> =Linux
>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>> >> environment:os.arch=i386
>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>> >> >> environment:os.version=2.6.32-25-generic
>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client environment:
>>>> >> user.name
>>>> >> >> =alaukik
>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>> >> >> environment:user.home=/home/alaukik
>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>> >> >> environment:user.dir=/home/alaukik/Documents/workspace/HBaseTest
>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Initiating
client
>>>> >> >> connection, connectString=alaukik:2222 sessionTimeout=60000
>>>> >> >> watcher=org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper@1126b07
>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ClientCnxn: Opening socket
>>>> connection
>>>> >> >> to server alaukik/192.168.1.2:2222
>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ClientCnxn: Socket connection
>>>> >> >> established to alaukik/192.168.1.2:2222, initiating session
>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ClientCnxn: Session establishment
>>>> >> >> complete on server alaukik/192.168.1.2:2222, sessionid
=
>>>> >> >> 0x12c5820cbf80003, negotiated timeout = 60000
>>>> >> >> 10/11/16 23:46:30 INFO client.HConnectionManager$TableServers:
>>>> >> >> getMaster attempt 0 of 4 failed; retrying after sleep of
5000
>>>> >> >> java.io.IOException: Call to /192.168.1.2:60000 failed
on local
>>>> >> >> exception: java.io.EOFException
>>>> >> >>        at
>>>> >> >>
>>>> >>
>>>> org.apache.hadoop.hbase.ipc.HBaseClient.wrapException(HBaseClient.java:779)
>>>> >> >>        at
>>>> >> >> org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:748)
>>>> >> >>        at
>>>> >> >>
>>>> org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:255)
>>>> >> >>        at $Proxy0.getProtocolVersion(Unknown Source)
>>>> >> >>        at
>>>> >> org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:412)
>>>> >> >>        at
>>>> >> org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:388)
>>>> >> >>        at
>>>> >> org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:435)
>>>> >> >>        at
>>>> >> >>
>>>> >>
>>>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getMaster(HConnectionManager.java:383)
>>>> >> >>        at
>>>> >> >> org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:78)
>>>> >> >>        at com.gt.hbase.HBase2.main(HBase2.java:30)
>>>> >> >> Caused by: java.io.EOFException
>>>> >> >>        at java.io.DataInputStream.readInt(DataInputStream.java:375)
>>>> >> >>        at
>>>> >> >>
>>>> >>
>>>> org.apache.hadoop.hbase.ipc.HBaseClient$Connection.receiveResponse(HBaseClient.java:512)
>>>> >> >>        at
>>>> >> >>
>>>> >>
>>>> org.apache.hadoop.hbase.ipc.HBaseClient$Connection.run(HBaseClient.java:452)
>>>> >> >>
>>>> >> >>
>>>> >> >> Kindly help,
>>>> >> >> Alaukik
>>>> >> >>
>>>> >> >
>>>> >>
>>>> >
>>>>
>>>
>>
>
>

Mime
View raw message