hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alaukik Aggarwal <alaukik.aggar...@gmail.com>
Subject Re: Problem in Running HBase in Pseudo Distributed Mode
Date Thu, 18 Nov 2010 02:38:32 GMT
I killed the zookeeper and other processes running as hbase shell was
still showing the same exception ...
I have not yet been successful in storing any data in hbase.

I have attached a fresh log of zookeeper, master and regionserver when
they are running. I can find no exceptions in either of the files.

By zookeeper data, hbase connection information in its log? I have
attached fresh logs and this information is not there.

> Tried using localhost everywhere instead of server name(alaukik) too? Do you
> get the same exception in that case? By no master log you mean no exceptions
> right?

I have tried using localhost instead of 192.168.1.2 (and 'alaukik').
Yes, I got the same exception while accessing information through
shell.

Yes, there are no exceptions in master log or any other log. That is
what is more confusing.



On Wed, Nov 17, 2010 at 8:29 PM, Buttler, David <buttler1@llnl.gov> wrote:
> Why was zookeeper killed?  Did you ever look into the zookeeper data to see if hbase
was able to store it information in there?
>
> Dave
>
> -----Original Message-----
> From: Alaukik Aggarwal [mailto:alaukik.aggarwal@gmail.com]
> Sent: Wednesday, November 17, 2010 4:45 PM
> To: user@hbase.apache.org
> Subject: Re: Problem in Running HBase in Pseudo Distributed Mode
>
> I have turned distributed flag to true, but still the problem persists ...
>
> Following are the recent logs of Zookeeper
>
> 010-11-17 18:39:26,029 INFO
> org.apache.zookeeper.server.ZooKeeperServerMain: Starting server
> 2010-11-17 18:39:26,071 INFO
> org.apache.zookeeper.server.ZooKeeperServer: Server
> environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51
> GMT
> 2010-11-17 18:39:26,072 INFO
> org.apache.zookeeper.server.ZooKeeperServer: Server
> environment:host.name=alaukik
> 2010-11-17 18:39:26,072 INFO
> org.apache.zookeeper.server.ZooKeeperServer: Server
> environment:java.version=1.6.0_22
> 2010-11-17 18:39:26,072 INFO
> org.apache.zookeeper.server.ZooKeeperServer: Server
> environment:java.vendor=Sun Microsystems Inc.
> 2010-11-17 18:39:26,072 INFO
> org.apache.zookeeper.server.ZooKeeperServer: Server
> environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.22/jre
> 2010-11-17 18:39:26,072 INFO
> org.apache.zookeeper.server.ZooKeeperServer: Server
> environment:java.class.path=/home/alaukik/Documents/hbase-0.20.6/bin/../conf:/usr/lib/jvm/java-6-sun-1.6.0.22//lib/tools.jar:/home/alaukik/Documents/hbase-0.20.6/bin/..:/home/alaukik/Documents/hbase-0.20.6/bin/../hbase-0.20.6.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../hbase-0.20.6-test.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/commons-cli-2.0-SNAPSHOT.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/commons-el-from-jetty-5.1.4.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/commons-httpclient-3.0.1.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/commons-logging-1.0.4.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/commons-logging-api-1.0.4.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/commons-math-1.1.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/hadoop-0.20.2-core.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/hadoop-0.20.2-test.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/jasper-compiler-5.5.12.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/jasper-runtime-5.5.12.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/jetty-6.1.14.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/jetty-util-6.1.14.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/jruby-complete-1.2.0.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/junit-4.8.1.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/libthrift-r771587.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/log4j-1.2.15.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/lucene-core-2.2.0.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/servlet-api-2.5-6.1.14.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/xmlenc-0.52.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/zookeeper-3.2.2.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/jsp-2.1/jsp-2.1.jar:/home/alaukik/Documents/hbase-0.20.6/bin/../lib/jsp-2.1/jsp-api-2.1.jar
> 2010-11-17 18:39:26,072 INFO
> org.apache.zookeeper.server.ZooKeeperServer: Server
> environment:java.library.path=/home/alaukik/Documents/hbase-0.20.6/bin/../lib/native/Linux-i386-32
> 2010-11-17 18:39:26,072 INFO
> org.apache.zookeeper.server.ZooKeeperServer: Server
> environment:java.io.tmpdir=/tmp
> 2010-11-17 18:39:26,072 INFO
> org.apache.zookeeper.server.ZooKeeperServer: Server
> environment:java.compiler=<NA>
> 2010-11-17 18:39:26,072 INFO
> org.apache.zookeeper.server.ZooKeeperServer: Server
> environment:os.name=Linux
> 2010-11-17 18:39:26,072 INFO
> org.apache.zookeeper.server.ZooKeeperServer: Server
> environment:os.arch=i386
> 2010-11-17 18:39:26,073 INFO
> org.apache.zookeeper.server.ZooKeeperServer: Server
> environment:os.version=2.6.32-25-generic
> 2010-11-17 18:39:26,073 INFO
> org.apache.zookeeper.server.ZooKeeperServer: Server
> environment:user.name=alaukik
> 2010-11-17 18:39:26,073 INFO
> org.apache.zookeeper.server.ZooKeeperServer: Server
> environment:user.home=/home/alaukik
> 2010-11-17 18:39:26,073 INFO
> org.apache.zookeeper.server.ZooKeeperServer: Server
> environment:user.dir=/home/alaukik/Documents/hbase-0.20.6
> 2010-11-17 18:39:26,223 INFO
> org.apache.zookeeper.server.persistence.FileSnap: Reading snapshot
> /tmp/hbase-alaukik/zookeeper/version-2/snapshot.0
> 2010-11-17 18:39:26,298 INFO
> org.apache.zookeeper.server.persistence.FileTxnSnapLog: Snapshotting:
> 1
> 2010-11-17 18:39:27,323 INFO
> org.apache.zookeeper.server.NIOServerCnxn: Connected to
> /127.0.0.1:48375 lastZxid 1
> 2010-11-17 18:39:27,331 INFO
> org.apache.zookeeper.server.NIOServerCnxn: Finished init of
> 0x12c5c32002c0000 valid:true
> 2010-11-17 18:39:27,331 INFO
> org.apache.zookeeper.server.NIOServerCnxn: Renewing session
> 0x12c5c32002c0000
> Wed Nov 17 18:40:51 EST 2010 Stopping zookeeper
> Wed Nov 17 18:40:51 EST 2010 Killing zookeeper
>
>
> On Wed, Nov 17, 2010 at 6:03 PM, Buttler, David <buttler1@llnl.gov> wrote:
>> I believe that you should have turned the distributed flag to true.  Also, you should
check your zookeeper to see if the master had successfully registered there.
>>
>> Dave
>>
>> -----Original Message-----
>> From: Alaukik Aggarwal [mailto:alaukik.aggarwal@gmail.com]
>> Sent: Wednesday, November 17, 2010 1:34 PM
>> To: user@hbase.apache.org
>> Subject: Re: Problem in Running HBase in Pseudo Distributed Mode
>>
>> Please... any suggestions ??
>>
>>
>> On Wed, Nov 17, 2010 at 12:36 PM, Alaukik Aggarwal
>> <alaukik.aggarwal@gmail.com> wrote:
>>> I tried this. I waited for 5 min before executing list command on shell.
>>>
>>> Also,there was no log in HMaster logs when this exception (ERROR:
>>> org.apache.hadoop.hbase.MasterNotRunningException: null) was thrown
>>> while accessing through HBase shell.
>>>
>>>
>>>
>>> On Wed, Nov 17, 2010 at 3:12 AM, Hari Sreekumar
>>> <hsreekumar@clickable.com> wrote:
>>>> It seems to be all right. How long do you wait after starting HBase before
>>>> trying to list? Wait 5 mins after starting the daemons before listing. Did
>>>> you try list after checking the master log (the one you have uploaded here)
>>>> ? You could also try using localhost instead of the hostname in the conf
>>>> files. Let me know..
>>>>
>>>> hari
>>>>
>>>> On Wed, Nov 17, 2010 at 12:57 PM, Alaukik Aggarwal <
>>>> alaukik.aggarwal@gmail.com> wrote:
>>>>
>>>>> $ bin/hadoop fs -ls /
>>>>> Found 2 items
>>>>> drwxr-xr-x   - alaukik supergroup          0 2010-11-16 23:28 /hbase
>>>>> drwxr-xr-x   - alaukik supergroup          0 2010-11-16 23:17 /tmp
>>>>>
>>>>> $ bin/hadoop fs -ls /hbase
>>>>> Found 4 items
>>>>> drwxr-xr-x   - alaukik supergroup          0 2010-11-16 23:26 /hbase/-ROOT-
>>>>> drwxr-xr-x   - alaukik supergroup          0 2010-11-16 23:17 /hbase/.META.
>>>>> drwxr-xr-x   - alaukik supergroup          0 2010-11-16 23:39 /hbase/.logs
>>>>> -rw-r--r--   3 alaukik supergroup          3 2010-11-16 23:17
>>>>> /hbase/hbase.version
>>>>>
>>>>> This also seems to fine.
>>>>>
>>>>> What could be the reason? :S
>>>>>
>>>>> Also, when does HMaster give the following in its Log:
>>>>> Failed to read: org.apache.zookeeper.KeeperException$NoNodeException:
>>>>> KeeperErrorCode = NoNode for /hbase/master
>>>>>
>>>>> Alaukik
>>>>>
>>>>>
>>>>> On Wed, Nov 17, 2010 at 2:03 AM, Hari Sreekumar
>>>>> <hsreekumar@clickable.com> wrote:
>>>>> > No, for pseudo distributed mode, you shouldn't set
>>>>> hbase.cluster.distributed
>>>>> > to true. /etc/hosts seems to be fine. And HMaster is running fine
as per
>>>>> the
>>>>> > log file. Did you try browsing root in HDFS? (dfs -ls /). Has a
directory
>>>>> > named hbase been created automatically? Does it contain anything?
>>>>> >
>>>>> > On Wed, Nov 17, 2010 at 11:06 AM, Alaukik Aggarwal <
>>>>> > alaukik.aggarwal@gmail.com> wrote:
>>>>> >
>>>>> >> Thanks for your quick reply.
>>>>> >>
>>>>> >> $ cat /etc/hosts
>>>>> >> 127.0.0.1       localhost
>>>>> >> 192.168.1.2     alaukik
>>>>> >>
>>>>> >> # The following lines are desirable for IPv6 capable hosts
>>>>> >> ::1     localhost ip6-localhost ip6-loopback
>>>>> >> fe00::0 ip6-localnet
>>>>> >> ff00::0 ip6-mcastprefix
>>>>> >> ff02::1 ip6-allnodes
>>>>> >> ff02::2 ip6-allrouters
>>>>> >> ff02::3 ip6-allhosts
>>>>> >>
>>>>> >>
>>>>> >> My OS is Ubuntu 10.04.1.
>>>>> >>
>>>>> >> In regionservers.log:
>>>>> >> Tue Nov 16 23:38:54 EST 2010 Starting regionserver on alaukik
>>>>> >> ulimit -n 1024
>>>>> >> 2010-11-16 23:38:55,706 WARN
>>>>> >> org.apache.hadoop.hbase.regionserver.HRegionServer: Not starting
a
>>>>> >> distinct region server because hbase.cluster.distributed is
false
>>>>> >>
>>>>> >> Should we set distributed as true?
>>>>> >> I am trying to run this in pseudo-distributed mode. And on HBase
site,
>>>>> >> it is mentioned that this is set true only in distributed mode.
>>>>> >>
>>>>> >> Alaukik
>>>>> >>
>>>>> >>
>>>>> >>
>>>>> >> On Wed, Nov 17, 2010 at 12:00 AM, Hari Sreekumar
>>>>> >> <hsreekumar@clickable.com> wrote:
>>>>> >> > Hi,
>>>>> >> >   hmm... It seems HRegionServer is unable to start because
it doesn't
>>>>> see
>>>>> >> > the HMaster at 192.168.1.2:60000. Can you post your /etc/hosts
file?
>>>>> >> There
>>>>> >> > might be issues with the wrong IP being reported. What
is your OS?
>>>>> >> >
>>>>> >> > hari
>>>>> >> >
>>>>> >> > On Wed, Nov 17, 2010 at 10:21 AM, Alaukik Aggarwal <
>>>>> >> > alaukik.aggarwal@gmail.com> wrote:
>>>>> >> >
>>>>> >> >> Hi,
>>>>> >> >>
>>>>> >> >> I am running HBase configured in Pseudo-distributed
mode (Hadoop also
>>>>> >> >> in Pseudo Distributed mode)
>>>>> >> >> Hadoop version: 0.20.2
>>>>> >> >> HBase version: 0.20.6
>>>>> >> >>
>>>>> >> >> On running any command (for instance, list) in HBase
shell, it gives
>>>>> me:
>>>>> >> >> ERROR: org.apache.hadoop.hbase.MasterNotRunningException:
null
>>>>> >> >>
>>>>> >> >> I can see master running at: http://BLOCKEDBLOCKEDalaukik:60010/master.jsp
>>>>> >> >> (Similarly, I can also see namenode running in Web
UI).
>>>>> >> >>
>>>>> >> >> On jps, I get all the required processes running:
>>>>> >> >>
>>>>> >> >> $ jps
>>>>> >> >> 9513 HQuorumPeer
>>>>> >> >> 9259 TaskTracker
>>>>> >> >> 9099 JobTracker
>>>>> >> >> 9771 Jps
>>>>> >> >> 8677 NameNode
>>>>> >> >> 9572 HMaster
>>>>> >> >> 9019 SecondaryNameNode
>>>>> >> >> 8848 DataNode
>>>>> >> >>
>>>>> >> >> I have attached a fresh log of hbase-master and my
hbase-site.xml
>>>>> file.
>>>>> >> >>
>>>>> >> >> I cannot see any exception in the log, except a Failed
notification:
>>>>> >> >> Failed to read: org.apache.zookeeper.KeeperException$NoNodeException:
>>>>> >> >> KeeperErrorCode = NoNode for /hbase/master
>>>>> >> >>
>>>>> >> >> Also if I try to access HBase through Java client (exact
sample code
>>>>> >> >> given on apache HBase site), I get the follwoing output:
>>>>> >> >> 10/11/16 23:46:29 WARN hbase.HBaseConfiguration: instantiating
>>>>> >> >> HBaseConfiguration() is deprecated. Please use
>>>>> >> >> HBaseConfiguration#create() to construct a plain Configuration
>>>>> >> >> 2
>>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeperWrapper:
Reconnecting to
>>>>> >> >> zookeeper
>>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>>> >> >> environment:zookeeper.version=3.3.1-942149, built on
05/07/2010 17:14
>>>>> >> >> GMT
>>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
environment:
>>>>> >> host.name
>>>>> >> >> =alaukik
>>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>>> >> >> environment:java.version=1.6.0_22
>>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>>> >> >> environment:java.vendor=Sun Microsystems Inc.
>>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>>> >> >> environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.22/jre
>>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>>> >> >> environment:java.class.path=/home/.............log4j-1.2.15.jar
>>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>>> >> >>
>>>>> >> >>
>>>>> >>
>>>>> environment:java.library.path=/usr/lib/jvm/java-6-sun-1.6.0.22/jre/lib/i386/server:/usr/lib/jvm/java-6-sun-1.6.0.22/jre/lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.22/jre/../lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.22/jre/lib/i386/client:/usr/lib/jvm/java-6-sun-1.6.0.22/jre/lib/i386:/usr/lib/xulrunner-addons:/usr/lib/xulrunner-addons:/usr/java/packages/lib/i386:/lib:/usr/lib
>>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>>> >> >> environment:java.io.tmpdir=/tmp
>>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>>> >> >> environment:java.compiler=<NA>
>>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
environment:
>>>>> os.name
>>>>> >> >> =Linux
>>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>>> >> environment:os.arch=i386
>>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>>> >> >> environment:os.version=2.6.32-25-generic
>>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
environment:
>>>>> >> user.name
>>>>> >> >> =alaukik
>>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>>> >> >> environment:user.home=/home/alaukik
>>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
>>>>> >> >> environment:user.dir=/home/alaukik/Documents/workspace/HBaseTest
>>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Initiating
client
>>>>> >> >> connection, connectString=alaukik:2222 sessionTimeout=60000
>>>>> >> >> watcher=org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper@1126b07
>>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ClientCnxn: Opening
socket
>>>>> connection
>>>>> >> >> to server alaukik/192.168.1.2:2222
>>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ClientCnxn: Socket
connection
>>>>> >> >> established to alaukik/192.168.1.2:2222, initiating
session
>>>>> >> >> 10/11/16 23:46:29 INFO zookeeper.ClientCnxn: Session
establishment
>>>>> >> >> complete on server alaukik/192.168.1.2:2222, sessionid
=
>>>>> >> >> 0x12c5820cbf80003, negotiated timeout = 60000
>>>>> >> >> 10/11/16 23:46:30 INFO client.HConnectionManager$TableServers:
>>>>> >> >> getMaster attempt 0 of 4 failed; retrying after sleep
of 5000
>>>>> >> >> java.io.IOException: Call to /192.168.1.2:60000 failed
on local
>>>>> >> >> exception: java.io.EOFException
>>>>> >> >>        at
>>>>> >> >>
>>>>> >>
>>>>> org.apache.hadoop.hbase.ipc.HBaseClient.wrapException(HBaseClient.java:779)
>>>>> >> >>        at
>>>>> >> >> org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:748)
>>>>> >> >>        at
>>>>> >> >>
>>>>> org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:255)
>>>>> >> >>        at $Proxy0.getProtocolVersion(Unknown Source)
>>>>> >> >>        at
>>>>> >> org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:412)
>>>>> >> >>        at
>>>>> >> org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:388)
>>>>> >> >>        at
>>>>> >> org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:435)
>>>>> >> >>        at
>>>>> >> >>
>>>>> >>
>>>>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getMaster(HConnectionManager.java:383)
>>>>> >> >>        at
>>>>> >> >> org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:78)
>>>>> >> >>        at com.gt.hbase.HBase2.main(HBase2.java:30)
>>>>> >> >> Caused by: java.io.EOFException
>>>>> >> >>        at java.io.DataInputStream.readInt(DataInputStream.java:375)
>>>>> >> >>        at
>>>>> >> >>
>>>>> >>
>>>>> org.apache.hadoop.hbase.ipc.HBaseClient$Connection.receiveResponse(HBaseClient.java:512)
>>>>> >> >>        at
>>>>> >> >>
>>>>> >>
>>>>> org.apache.hadoop.hbase.ipc.HBaseClient$Connection.run(HBaseClient.java:452)
>>>>> >> >>
>>>>> >> >>
>>>>> >> >> Kindly help,
>>>>> >> >> Alaukik
>>>>> >> >>
>>>>> >> >
>>>>> >>
>>>>> >
>>>>>
>>>>
>>>
>>
>>
>
>

Mime
View raw message