hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Bates <christopher.andrew.ba...@gmail.com>
Subject Re: HBase 0.20.1 Distributed Install Problems
Date Tue, 10 Nov 2009 01:42:33 GMT
I'm pretty sure its running...it goes through the same check as Hadoop does.
 But at the end of the log file it says 0 region servers...even though I
edited the regionservers file so it matched our Hadoop slaves file and the
conf file ofcourse.  And I think it also says the master is on port 60000
when the install directions say its supposed to be 60010?  I also added in
the hdfs-site.xml to all the conf folders and made sure all the installs
were all the same on each box.


Also, another thing to note is that when I try running the shut down script,
the master node takes infinitely long to shut down and I always have to
manually kill the process.


[hadoop@crunch hbase-0.20.1]$ bin/start-hbase.sh

crunch2: Warning: Permanently added 'crunch2' (RSA) to the list of known
hosts.

chris: Warning: Permanently added 'chris' (RSA) to the list of known hosts.

chanel: Warning: Permanently added 'chanel' (RSA) to the list of known
hosts.

crunch3: Warning: Permanently added 'crunch3' (RSA) to the list of known
hosts.

chanel2: Warning: Permanently added 'chanel2' (RSA) to the list of known
hosts.

crunch2: zookeeper running as process 16233. Stop it first.

chanel: zookeeper running as process 29181. Stop it first.

crunch3: zookeeper running as process 28820. Stop it first.

chanel2: starting zookeeper, logging to
/opt/hadoop/hbase-0.20.1/bin/../logs/hbase-hadoop-zookeeper-chanel2.out

chris: zookeeper running as process 29030. Stop it first.

starting master, logging to
/opt/hadoop/hbase-0.20.1/bin/../logs/hbase-hadoop-master-crunch.out

crunch2: Warning: Permanently added 'crunch2' (RSA) to the list of known
hosts.

chanel: Warning: Permanently added 'chanel' (RSA) to the list of known
hosts.

chanel2: Warning: Permanently added 'chanel2' (RSA) to the list of known
hosts.

crunch3: Warning: Permanently added 'crunch3' (RSA) to the list of known
hosts.

chris: Warning: Permanently added 'chris' (RSA) to the list of known hosts.

- Hide quoted text -

chanel: regionserver running as process 7254. Stop it first.

crunch2: regionserver running as process 13502. Stop it first.

chanel2: regionserver running as process 21510. Stop it first.

crunch3: regionserver running as process 32497. Stop it first.

chris: regionserver running as process 6480. Stop it first.


I'm logged into our master node (Crunch).


And from the logs:



Mon Nov  9 17:44:14 EST 2009 Starting master on crunchulimit -n
900002009-11-09 17:44:15,647 INFO org.apache.hadoop.hbase.master.HMaster:
vmName=Java HotSpot(TM) Client VM, vmVendor=Sun Microsystems Inc.,
vmVersion=14.0-b16

2009-11-09 17:44:15,648 INFO org.apache.hadoop.hbase.master.HMaster:
vmInputArguments=[-Xmx1000m, -XX:+HeapDumpOnOutOfMemoryError,
-XX:+UseConcMarkSweepGC, -XX:+CMSIncrementalMode, -Dhbase.log.dir=/op

t/hadoop/hbase-0.20.1/bin/../logs,
-Dhbase.log.file=hbase-hadoop-master-crunch.log,
-Dhbase.home.dir=/opt/hadoop/hbase-0.20.1/bin/.., -Dhbase.id.str=hadoop,
-Dhbase.root.logger=INFO,DRFA, -Djava.libra

ry.path=/opt/hadoop/hbase-0.20.1/bin/../lib/native/Linux-i386-32]2009-11-09
17:44:15,803 INFO org.apache.hadoop.hbase.master.HMaster: My address is
172.16.1.220:600002009-11-09 17:44:16,474 INFO
org.apache.hadoop.hbase.ipc.HBaseRpcMetrics: Initializing RPC Metrics with
hostName=HMaster, port=600002009-11-09 17:44:16,706 INFO
org.apache.zookeeper.ZooKeeper: Client
environment:zookeeper.version=3.2.1-808558, built on 08/27/2009 18:48
GMT2009-11-09 17:44:16,707 INFO org.apache.zookeeper.ZooKeeper: Client
environment:=hostIP(redacted)2009-11-09 17:44:16,707 INFO
org.apache.zookeeper.ZooKeeper: Client
environment:java.version=1.6.0_142009-11-09 17:44:16,707 INFO
org.apache.zookeeper.ZooKeeper: Client environment:java.vendor=Sun
Microsystems Inc.2009-11-09 17:44:16,707 INFO
org.apache.zookeeper.ZooKeeper: Client
environment:java.home=/opt/jdk1.6.0_14/jre2009-11-09 17:44:16,707 INFO
org.apache.zookeeper.ZooKeeper: Client
environment:java.class.path=/opt/hadoop/hbase-0.20.1/bin/../conf:/opt/jdk1.6.0_14/lib/tools.jar:/opt/hadoop/hbase-0.20.1/bin/..:/opt

/hadoop/hbase-0.20.1/bin/../hbase-0.20.1.jar:/opt/hadoop/hbase-0.20.1/bin/../hbase-0.20.1-test.jar:/opt/hadoop/hbase-0.20.1/bin/../lib/AgileJSON-2009-03-30.jar:/opt/hadoop/hbase-0.20.1/bin/../lib/comm

ons-cli-2.0-SNAPSHOT.jar:/opt/hadoop/hbase-0.20.1/bin/../lib/commons-el-from-jetty-5.1.4.jar:/opt/hadoop/hbase-0.20.1/bin/../lib/commons-httpclient-3.0.1.jar:/opt/hadoop/hbase-0.20.1/bin/../lib/common

s-logging-1.0.4.jar:/opt/hadoop/hbase-0.20.1/bin/../lib/commons-logging-api-1.0.4.jar:/opt/hadoop/hbase-0.20.1/bin/../lib/commons-math-1.1.jar:/opt/hadoop/hbase-0.20.1/bin/../lib/hadoop-0.20.1-hdfs127

-core.jar:/opt/hadoop/hbase-0.20.1/bin/../lib/hadoop-0.20.1-test.jar:/opt/hadoop/hbase-0.20.1/bin/../lib/jasper-compiler-5.5.12.jar:/opt/hadoop/hbase-0.20.1/bin/../lib/jasper-runtime-5.5.12.jar:/opt/h

adoop/hbase-0.20.1/bin/../lib/jetty-6.1.14.jar:/opt/hadoop/hbase-0.20.1/bin/../lib/jetty-util-6.1.14.jar:/opt/hadoop/hbase-0.20.1/bin/../lib/jruby-complete-1.2.0.jar:/opt/hadoop/hbase-0.20.1/bin/../li

b/json.jar:/opt/hadoop/hbase-0.20.1/bin/../lib/junit-3.8.1.jar:/opt/hadoop/hbase-0.20.1/bin/../lib/libthrift-r771587.jar:/opt/hadoop/hbase-0.20.1/bin/../lib/log4j-1.2.15.jar:/opt/hadoop/hbase-0.20.1/b

in/../lib/lucene-core-2.2.0.jar:/opt/hadoop/hbase-0.20.1/bin/../lib/servlet-api-2.5-6.1.14.jar:/opt/hadoop/hbase-0.20.1/bin/../lib/xmlenc-0.52.jar:/opt/hadoop/hbase-0.20.1/bin/../lib/zookeeper-3.2.1.j

ar:/opt/hadoop/hbase-0.20.1/bin/../lib/jsp-2.1/jsp-2.1.jar:/opt/hadoop/hbase-0.20.1/bin/../lib/jsp-2.1/jsp-api-2.1.jar:HADOOP_CONF_DIR

2009-11-09 17:44:16,707 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.library.path=/opt/hadoop/hbase-0.20.1/bin/../lib/native/Linux-i386-32

2009-11-09 17:44:16,707 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/tmp2009-11-09 17:44:16,707 INFO
org.apache.zookeeper.ZooKeeper: Client environment:java.compiler=<NA>

2009-11-09 17:44:16,707 INFO org.apache.zookeeper.ZooKeeper: Client
environment=Linux

2009-11-09 17:44:16,708 INFO org.apache.zookeeper.ZooKeeper: Client
environment:os.arch=i386

2009-11-09 17:44:16,708 INFO org.apache.zookeeper.ZooKeeper: Client
environment:os.version=2.6.18-128.1.6.el5

2009-11-09 17:44:16,708 INFO org.apache.zookeeper.ZooKeeper: Client
environment:=hadoop

2009-11-09 17:44:16,708 INFO org.apache.zookeeper.ZooKeeper: Client
environment:user.home=/home/hadoop

2009-11-09 17:44:16,708 INFO org.apache.zookeeper.ZooKeeper: Client
environment:user.dir=/opt/hadoop/hbase-0.20.1

2009-11-09 17:44:16,711 INFO org.apache.zookeeper.ZooKeeper: Initiating
client connection,
connectString=chris:2181,crunch3:2181,crunch2:2181,chanel2:2181,chanel:2181
sessionTimeout=60000 watcher=Thre

ad[Thread-0,5,main]

2009-11-09 17:44:16,716 INFO org.apache.zookeeper.ClientCnxn:
zookeeper.disableAutoWatchReset is false

2009-11-09 17:44:16,764 INFO org.apache.zookeeper.ClientCnxn: Attempting
connection to server chanel/:2181

2009-11-09 17:44:16,767 INFO org.apache.zookeeper.ClientCnxn: Priming
connection to java.nio.channels.SocketChannel[connected local=/:53732
 remote=chanel/2181]

2009-11-09 17:44:16,787 INFO org.apache.zookeeper.ClientCnxn: Server
connection successful

2009-11-09 17:44:16,819 INFO org.apache.hadoop.hbase.master.RegionManager:
-ROOT- region unset (but not set to be reassigned)

2009-11-09 17:45:16,789 INFO org.apache.hadoop.hbase.master.ServerManager: 0
region servers, 0 dead, average load NaN

2009-11-09 17:46:16,790 INFO org.apache.hadoop.hbase.master.ServerManager: 0
region servers, 0 dead, average load NaN

2009-11-09 17:47:16,793 INFO org.apache.hadoop.hbase.master.ServerManager: 0
region servers, 0 dead, average load NaN

2009-11-09 17:48:16,794 INFO org.apache.hadoop.hbase.master.ServerManager: 0
region servers, 0 dead, average load NaN

2009-11-09 17:49:16,796 INFO org.apache.hadoop.hbase.master.ServerManager: 0
region servers, 0 dead, average load NaN

2009-11-09 17:50:16,799 INFO org.apache.hadoop.hbase.master.ServerManager: 0
region servers, 0 dead, average load NaN

2009-11-09 17:51:16,800 INFO org.apache.hadoop.hbase.master.ServerManager: 0
region servers, 0 dead, average load NaN

On Mon, Nov 9, 2009 at 5:26 PM, stack <stack@duboce.net> wrote:

> On Mon, Nov 9, 2009 at 12:59 PM, Chris Bates <
> christopher.andrew.bates@gmail.com> wrote:
>
> > Hi all,
> >
> >   I'm new to HBase and trying to configure it to run with a cluster of 6
> > machines.  I'm logged into the Master Node and ran the start scripts as
> > directed from the Wiki,
>
>
> You are reading
>
> http://hadoop.apache.org/hbase/docs/r0.20.1/api/overview-summary.html#overview_description
> ?
>
>
> </configuration>
> >
> > here's the ugly error:
> >
> > hbase(main):001:0> create 'stations', {NAME=>'info',VERSIONS=>1}
> > 09/11/09 14:54:09 INFO client.HConnectionManager$TableServers: getMaster
> > attempt 0 of 5 failed; retrying after sleep of 2000
> > java.net.ConnectException: Connection refused
> >
>
>
>
> Is HBASE up?  Check the master logs.  Check the UI.
>
> Sorry, the ruby shell can dump ugly stack traces.  There's an issue to
> tighten them up.
>
> St.Ack
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message