hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hari Sreekumar <hsreeku...@clickable.com>
Subject Re: Problem in Running HBase in Pseudo Distributed Mode
Date Thu, 18 Nov 2010 02:29:58 GMT
Tried using localhost everywhere instead of server name(alaukik) too? Do you
get the same exception in that case? By no master log you mean no exceptions
right?

On Wed, Nov 17, 2010 at 11:06 PM, Alaukik Aggarwal <
alaukik.aggarwal@gmail.com> wrote:

> I tried this. I waited for 5 min before executing list command on shell.
>
> Also,there was no log in HMaster logs when this exception (ERROR:
> org.apache.hadoop.hbase.MasterNotRunningException: null) was thrown
> while accessing through HBase shell.
>
>
>
> On Wed, Nov 17, 2010 at 3:12 AM, Hari Sreekumar
> <hsreekumar@clickable.com> wrote:
> > It seems to be all right. How long do you wait after starting HBase
> before
> > trying to list? Wait 5 mins after starting the daemons before listing.
> Did
> > you try list after checking the master log (the one you have uploaded
> here)
> > ? You could also try using localhost instead of the hostname in the conf
> > files. Let me know..
> >
> > hari
> >
> > On Wed, Nov 17, 2010 at 12:57 PM, Alaukik Aggarwal <
> > alaukik.aggarwal@gmail.com> wrote:
> >
> >> $ bin/hadoop fs -ls /
> >> Found 2 items
> >> drwxr-xr-x   - alaukik supergroup          0 2010-11-16 23:28 /hbase
> >> drwxr-xr-x   - alaukik supergroup          0 2010-11-16 23:17 /tmp
> >>
> >> $ bin/hadoop fs -ls /hbase
> >> Found 4 items
> >> drwxr-xr-x   - alaukik supergroup          0 2010-11-16 23:26
> /hbase/-ROOT-
> >> drwxr-xr-x   - alaukik supergroup          0 2010-11-16 23:17
> /hbase/.META.
> >> drwxr-xr-x   - alaukik supergroup          0 2010-11-16 23:39
> /hbase/.logs
> >> -rw-r--r--   3 alaukik supergroup          3 2010-11-16 23:17
> >> /hbase/hbase.version
> >>
> >> This also seems to fine.
> >>
> >> What could be the reason? :S
> >>
> >> Also, when does HMaster give the following in its Log:
> >> Failed to read: org.apache.zookeeper.KeeperException$NoNodeException:
> >> KeeperErrorCode = NoNode for /hbase/master
> >>
> >> Alaukik
> >>
> >>
> >> On Wed, Nov 17, 2010 at 2:03 AM, Hari Sreekumar
> >> <hsreekumar@clickable.com> wrote:
> >> > No, for pseudo distributed mode, you shouldn't set
> >> hbase.cluster.distributed
> >> > to true. /etc/hosts seems to be fine. And HMaster is running fine as
> per
> >> the
> >> > log file. Did you try browsing root in HDFS? (dfs -ls /). Has a
> directory
> >> > named hbase been created automatically? Does it contain anything?
> >> >
> >> > On Wed, Nov 17, 2010 at 11:06 AM, Alaukik Aggarwal <
> >> > alaukik.aggarwal@gmail.com> wrote:
> >> >
> >> >> Thanks for your quick reply.
> >> >>
> >> >> $ cat /etc/hosts
> >> >> 127.0.0.1       localhost
> >> >> 192.168.1.2     alaukik
> >> >>
> >> >> # The following lines are desirable for IPv6 capable hosts
> >> >> ::1     localhost ip6-localhost ip6-loopback
> >> >> fe00::0 ip6-localnet
> >> >> ff00::0 ip6-mcastprefix
> >> >> ff02::1 ip6-allnodes
> >> >> ff02::2 ip6-allrouters
> >> >> ff02::3 ip6-allhosts
> >> >>
> >> >>
> >> >> My OS is Ubuntu 10.04.1.
> >> >>
> >> >> In regionservers.log:
> >> >> Tue Nov 16 23:38:54 EST 2010 Starting regionserver on alaukik
> >> >> ulimit -n 1024
> >> >> 2010-11-16 23:38:55,706 WARN
> >> >> org.apache.hadoop.hbase.regionserver.HRegionServer: Not starting a
> >> >> distinct region server because hbase.cluster.distributed is false
> >> >>
> >> >> Should we set distributed as true?
> >> >> I am trying to run this in pseudo-distributed mode. And on HBase
> site,
> >> >> it is mentioned that this is set true only in distributed mode.
> >> >>
> >> >> Alaukik
> >> >>
> >> >>
> >> >>
> >> >> On Wed, Nov 17, 2010 at 12:00 AM, Hari Sreekumar
> >> >> <hsreekumar@clickable.com> wrote:
> >> >> > Hi,
> >> >> >   hmm... It seems HRegionServer is unable to start because it
> doesn't
> >> see
> >> >> > the HMaster at 192.168.1.2:60000. Can you post your /etc/hosts
> file?
> >> >> There
> >> >> > might be issues with the wrong IP being reported. What is your
OS?
> >> >> >
> >> >> > hari
> >> >> >
> >> >> > On Wed, Nov 17, 2010 at 10:21 AM, Alaukik Aggarwal <
> >> >> > alaukik.aggarwal@gmail.com> wrote:
> >> >> >
> >> >> >> Hi,
> >> >> >>
> >> >> >> I am running HBase configured in Pseudo-distributed mode (Hadoop
> also
> >> >> >> in Pseudo Distributed mode)
> >> >> >> Hadoop version: 0.20.2
> >> >> >> HBase version: 0.20.6
> >> >> >>
> >> >> >> On running any command (for instance, list) in HBase shell,
it
> gives
> >> me:
> >> >> >> ERROR: org.apache.hadoop.hbase.MasterNotRunningException:
null
> >> >> >>
> >> >> >> I can see master running at: http://alaukik:60010/master.jsp
> >> >> >> (Similarly, I can also see namenode running in Web UI).
> >> >> >>
> >> >> >> On jps, I get all the required processes running:
> >> >> >>
> >> >> >> $ jps
> >> >> >> 9513 HQuorumPeer
> >> >> >> 9259 TaskTracker
> >> >> >> 9099 JobTracker
> >> >> >> 9771 Jps
> >> >> >> 8677 NameNode
> >> >> >> 9572 HMaster
> >> >> >> 9019 SecondaryNameNode
> >> >> >> 8848 DataNode
> >> >> >>
> >> >> >> I have attached a fresh log of hbase-master and my hbase-site.xml
> >> file.
> >> >> >>
> >> >> >> I cannot see any exception in the log, except a Failed
> notification:
> >> >> >> Failed to read:
> org.apache.zookeeper.KeeperException$NoNodeException:
> >> >> >> KeeperErrorCode = NoNode for /hbase/master
> >> >> >>
> >> >> >> Also if I try to access HBase through Java client (exact sample
> code
> >> >> >> given on apache HBase site), I get the follwoing output:
> >> >> >> 10/11/16 23:46:29 WARN hbase.HBaseConfiguration: instantiating
> >> >> >> HBaseConfiguration() is deprecated. Please use
> >> >> >> HBaseConfiguration#create() to construct a plain Configuration
> >> >> >> 2
> >> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeperWrapper: Reconnecting
to
> >> >> >> zookeeper
> >> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
> >> >> >> environment:zookeeper.version=3.3.1-942149, built on 05/07/2010
> 17:14
> >> >> >> GMT
> >> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client environment:
> >> >> host.name
> >> >> >> =alaukik
> >> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
> >> >> >> environment:java.version=1.6.0_22
> >> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
> >> >> >> environment:java.vendor=Sun Microsystems Inc.
> >> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
> >> >> >> environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.22/jre
> >> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
> >> >> >> environment:java.class.path=/home/.............log4j-1.2.15.jar
> >> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
> >> >> >>
> >> >> >>
> >> >>
> >>
> environment:java.library.path=/usr/lib/jvm/java-6-sun-1.6.0.22/jre/lib/i386/server:/usr/lib/jvm/java-6-sun-1.6.0.22/jre/lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.22/jre/../lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.22/jre/lib/i386/client:/usr/lib/jvm/java-6-sun-1.6.0.22/jre/lib/i386:/usr/lib/xulrunner-addons:/usr/lib/xulrunner-addons:/usr/java/packages/lib/i386:/lib:/usr/lib
> >> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
> >> >> >> environment:java.io.tmpdir=/tmp
> >> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
> >> >> >> environment:java.compiler=<NA>
> >> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client environment:
> >> os.name
> >> >> >> =Linux
> >> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
> >> >> environment:os.arch=i386
> >> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
> >> >> >> environment:os.version=2.6.32-25-generic
> >> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client environment:
> >> >> user.name
> >> >> >> =alaukik
> >> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
> >> >> >> environment:user.home=/home/alaukik
> >> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Client
> >> >> >> environment:user.dir=/home/alaukik/Documents/workspace/HBaseTest
> >> >> >> 10/11/16 23:46:29 INFO zookeeper.ZooKeeper: Initiating client
> >> >> >> connection, connectString=alaukik:2222 sessionTimeout=60000
> >> >> >> watcher=org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper@1126b07
> >> >> >> 10/11/16 23:46:29 INFO zookeeper.ClientCnxn: Opening socket
> >> connection
> >> >> >> to server alaukik/192.168.1.2:2222
> >> >> >> 10/11/16 23:46:29 INFO zookeeper.ClientCnxn: Socket connection
> >> >> >> established to alaukik/192.168.1.2:2222, initiating session
> >> >> >> 10/11/16 23:46:29 INFO zookeeper.ClientCnxn: Session establishment
> >> >> >> complete on server alaukik/192.168.1.2:2222, sessionid =
> >> >> >> 0x12c5820cbf80003, negotiated timeout = 60000
> >> >> >> 10/11/16 23:46:30 INFO client.HConnectionManager$TableServers:
> >> >> >> getMaster attempt 0 of 4 failed; retrying after sleep of 5000
> >> >> >> java.io.IOException: Call to /192.168.1.2:60000 failed on
local
> >> >> >> exception: java.io.EOFException
> >> >> >>        at
> >> >> >>
> >> >>
> >>
> org.apache.hadoop.hbase.ipc.HBaseClient.wrapException(HBaseClient.java:779)
> >> >> >>        at
> >> >> >> org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:748)
> >> >> >>        at
> >> >> >>
> >> org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:255)
> >> >> >>        at $Proxy0.getProtocolVersion(Unknown Source)
> >> >> >>        at
> >> >> org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:412)
> >> >> >>        at
> >> >> org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:388)
> >> >> >>        at
> >> >> org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:435)
> >> >> >>        at
> >> >> >>
> >> >>
> >>
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getMaster(HConnectionManager.java:383)
> >> >> >>        at
> >> >> >>
> org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:78)
> >> >> >>        at com.gt.hbase.HBase2.main(HBase2.java:30)
> >> >> >> Caused by: java.io.EOFException
> >> >> >>        at
> java.io.DataInputStream.readInt(DataInputStream.java:375)
> >> >> >>        at
> >> >> >>
> >> >>
> >>
> org.apache.hadoop.hbase.ipc.HBaseClient$Connection.receiveResponse(HBaseClient.java:512)
> >> >> >>        at
> >> >> >>
> >> >>
> >>
> org.apache.hadoop.hbase.ipc.HBaseClient$Connection.run(HBaseClient.java:452)
> >> >> >>
> >> >> >>
> >> >> >> Kindly help,
> >> >> >> Alaukik
> >> >> >>
> >> >> >
> >> >>
> >> >
> >>
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message