hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "shanmuganathan.r" <shanmuganatha...@zohocorp.com>
Subject Re: RE: Difficulty in use Hbase fully distributed mode
Date Mon, 18 Jul 2011 11:28:43 GMT
Hi Gaojinchao,

      Thanks for your reply...



I will try it .
---- On Mon, 18 Jul 2011 16:35:48 +0530 Gaojinchao&lt;gaojinchao@huawei.com&gt; wrote
---- 


You need use ntp. 
 
You can reference: 
http://hbase.apache.org/book/os.html#ntp 
 
Hi Gan, 
 
 Thanks for your reply.. 
 
 
 
Now Hmaster and one of my region server working properly but another one region server(slave)
not working . 
i am using the three node cluster 
 
 
master: namenode , datanode, tasktracker, jobtracker, zookeeper1,Hmaster 
slave: datanode, tasktracker, zookeeper2,Regionserver1 
slave001: datanode, tasktracker, zookeeper2,Regionserver1 
 
 
The log in the slave is 
 
2011-07-18 15:38:42,909 FATAL org.apache.hadoop.hbase.regionserver.HRegionServer: Master rejected
startup because clock is out of sync 
org.apache.hadoop.hbase.ClockOutOfSyncException: org.apache.hadoop.hbase.ClockOutOfSyncException:
Server slave,60020,1310983722679 has been rejected; Reported time is too far out of sync with
master. Time difference of 33514ms &amp;gt; max allowed of 30000ms 
 
 at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) 
 at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)

 at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

 at java.lang.reflect.Constructor.newInstance(Constructor.java:532) 
 at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:96) 
 at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:80) 
 at org.apache.hadoop.hbase.regionserver.HRegionServer.reportForDuty(HRegionServer.java:1506)

 at org.apache.hadoop.hbase.regionserver.HRegionServer.tryReportForDuty(HRegionServer.java:1470)

 at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:563) 
 at java.lang.Thread.run(Thread.java:636) 
Caused by: org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hbase.ClockOutOfSyncException:
Server slave,60020,1310983722679 has been rejected; Reported time is too far out of sync with
master. Time difference of 33514ms &amp;gt; max allowed of 30000ms 
 at org.apache.hadoop.hbase.master.ServerManager.checkClockSkew(ServerManager.java:181) 
 at org.apache.hadoop.hbase.master.ServerManager.regionServerStartup(ServerManager.java:129)

 at org.apache.hadoop.hbase.master.HMaster.regionServerStartup(HMaster.java:613) 
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

 at java.lang.reflect.Method.invoke(Method.java:616) 
 at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570) 
 at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039) 
 
 
 at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:771) 
 at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:257) 
 at $Proxy5.regionServerStartup(Unknown Source) 
 at org.apache.hadoop.hbase.regionserver.HRegionServer.reportForDuty(HRegionServer.java:1502)

 ... 3 more 
 
 
Regards 
 
 
Shanmuganathan 
 
 
 
 
 
---- On Mon, 18 Jul 2011 14:54:25 +0530 Gan&amp;lt;ganxiyun@gmail.com&amp;gt; wrote
---- 
 
try to use host name in hbase.rootdir instead of ip adress. 
 
On Mon, Jul 18, 2011 at 4:16 PM, Laurent Hatier 
&amp;lt;laurent.hatier@gmail.com&amp;gt; wrote: 
&amp;gt; Are you sure that Hadoop is started, because you use HDFS so you must start 
&amp;gt; it before HBase. 
&amp;gt; If not, try to change the HBase port to 60010 
&amp;gt; 
&amp;gt; 2011/7/18 shanmuganathan &amp;lt;shanmuganathan.r@zohocorp.com&amp;gt;

&amp;gt; 
&amp;gt;&amp;gt; Hi, 
&amp;gt;&amp;gt; 
&amp;gt;&amp;gt; I am new user for the hbase and I have trouble in starting HBase.

&amp;gt;&amp;gt; I am using the hadoop-0.20.2, zookeeper 3.3.3 and Hbase 0.90.1 
&amp;gt;&amp;gt; My conf/hbase-site.xml is 
&amp;gt;&amp;gt; 
&amp;gt;&amp;gt; 
&amp;gt;&amp;gt; &amp;lt;property&amp;gt; 
&amp;gt;&amp;gt; &amp;lt;name&amp;gt;hbase.rootdir&amp;lt;/name&amp;gt;

&amp;gt;&amp;gt; &amp;lt;value&amp;gt;hdfs://192.168.107.142:54310/hbase&amp;lt;/value&amp;gt;

&amp;gt;&amp;gt; &amp;lt;/property&amp;gt; 
&amp;gt;&amp;gt; 
&amp;gt;&amp;gt; &amp;lt;property&amp;gt; 
&amp;gt;&amp;gt; &amp;lt;name&amp;gt;hbase.cluster.distributed&amp;lt;/name&amp;gt;

&amp;gt;&amp;gt; &amp;lt;value&amp;gt;true&amp;lt;/value&amp;gt; 
&amp;gt;&amp;gt; &amp;lt;/property&amp;gt; 
&amp;gt;&amp;gt; 
&amp;gt;&amp;gt; &amp;lt;property&amp;gt; 
&amp;gt;&amp;gt; &amp;lt;name&amp;gt;hbase.zookeeper.property.clientPort&amp;lt;/name&amp;gt;

&amp;gt;&amp;gt; &amp;lt;value&amp;gt;2181&amp;lt;/value&amp;gt; 
&amp;gt;&amp;gt; &amp;lt;/property&amp;gt; 
&amp;gt;&amp;gt; 
&amp;gt;&amp;gt; &amp;lt;property&amp;gt; 
&amp;gt;&amp;gt; &amp;lt;name&amp;gt;hbase.zookeeper.property.dataDir&amp;lt;/name&amp;gt;

&amp;gt;&amp;gt; &amp;lt;value&amp;gt;/home/hadoop/zookeeperdata&amp;lt;/value&amp;gt;

&amp;gt;&amp;gt; &amp;lt;/property&amp;gt; 
&amp;gt;&amp;gt; 
&amp;gt;&amp;gt; &amp;lt;property&amp;gt; 
&amp;gt;&amp;gt; &amp;lt;name&amp;gt;hbase.master.port&amp;lt;/name&amp;gt;

&amp;gt;&amp;gt; &amp;lt;value&amp;gt;60000&amp;lt;/value&amp;gt;

&amp;gt;&amp;gt; &amp;lt;/property&amp;gt; 
&amp;gt;&amp;gt; 
&amp;gt;&amp;gt; &amp;lt;property&amp;gt; 
&amp;gt;&amp;gt; &amp;lt;name&amp;gt;hbase.zookeeper.quorum&amp;lt;/name&amp;gt;

&amp;gt;&amp;gt; &amp;lt;value&amp;gt;192.168.107.142,192.168.107.149,192.168.106.202&amp;lt;/value&amp;gt;

&amp;gt;&amp;gt; &amp;lt;/property&amp;gt; 
&amp;gt;&amp;gt; My Hadoop and zookeeper are working perfectly but when i started
the HBase 
&amp;gt;&amp;gt; ,I 
&amp;gt;&amp;gt; got the following errors in log. Please give me the solution for
this 
&amp;gt;&amp;gt; problem 
&amp;gt;&amp;gt; 2011-07-18 12:20:57,048 INFO 
&amp;gt;&amp;gt; org.apache.hadoop.hbase.master.ActiveMasterManager: 
&amp;gt;&amp;gt; Master=shanmuganathanr.zohocorpin.com:60000 
&amp;gt;&amp;gt; 2011-07-18 12:20:57,271 FATAL org.apache.hadoop.hbase.master.HMaster:

&amp;gt;&amp;gt; Unhandled 
&amp;gt;&amp;gt; exception. Starting shutdown. 
&amp;gt;&amp;gt; java.lang.IllegalArgumentException: Wrong FS: 
&amp;gt;&amp;gt; hdfs://192.168.107.142:54310/hbase, expected: 
&amp;gt;&amp;gt; hdfs://shanmuganathanr.zohocorpin.com:54310 
&amp;gt;&amp;gt; at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:310)

&amp;gt;&amp;gt; at 
&amp;gt;&amp;gt; 
&amp;gt;&amp;gt; org.apache.hadoop.hdfs.DistributedFileSystem.checkPath(DistributedFileSystem.jav

&amp;gt;&amp;gt; a:99) 
&amp;gt;&amp;gt; at 
&amp;gt;&amp;gt; 
&amp;gt;&amp;gt; org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.j

&amp;gt;&amp;gt; ava:155) 
&amp;gt;&amp;gt; at 
&amp;gt;&amp;gt; 
&amp;gt;&amp;gt; org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem

&amp;gt;&amp;gt; .java:462) 
&amp;gt;&amp;gt; at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:648) 
&amp;gt;&amp;gt; at 
&amp;gt;&amp;gt; 
&amp;gt;&amp;gt; org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.ja

&amp;gt;&amp;gt; va:232) 
&amp;gt;&amp;gt; at 
&amp;gt;&amp;gt; 
&amp;gt;&amp;gt; org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(Ma

&amp;gt;&amp;gt; sterFileSystem.java:105) 
&amp;gt;&amp;gt; at org.apache.hadoop.hbase.master.MasterFileSystem.&amp;lt;init&amp;gt;

&amp;gt;&amp;gt; (MasterFileSystem.java:90) 
&amp;gt;&amp;gt; at 
&amp;gt;&amp;gt; 
&amp;gt;&amp;gt; org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:342)

&amp;gt;&amp;gt; at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:278) 
&amp;gt;&amp;gt; 2011-07-18 12:20:57,274 INFO org.apache.hadoop.hbase.master.HMaster:

&amp;gt;&amp;gt; Aborting 
&amp;gt;&amp;gt; 2011-07-18 12:20:57,274 DEBUG org.apache.hadoop.hbase.master.HMaster:

&amp;gt;&amp;gt; Stopping 
&amp;gt;&amp;gt; service threads 
&amp;gt;&amp;gt; 2011-07-18 12:20:57,274 INFO org.apache.hadoop.ipc.HBaseServer: Stopping

&amp;gt;&amp;gt; server 
&amp;gt;&amp;gt; on 60000 
&amp;gt;&amp;gt; 2011-07-18 12:20:57,275 INFO org.apache.hadoop.ipc.HBaseServer: IPC
Server 
&amp;gt;&amp;gt; handler 1 on 60000: exiting 
&amp;gt;&amp;gt; 2011-07-18 12:20:57,275 INFO org.apache.hadoop.ipc.HBaseServer: IPC
Server 
&amp;gt;&amp;gt; handler 2 on 60000: exiting 
&amp;gt;&amp;gt; 2011-07-18 12:20:57,275 INFO org.apache.hadoop.ipc.HBaseServer: IPC
Server 
&amp;gt;&amp;gt; handler 0 on 60000: exiting 
&amp;gt;&amp;gt; 2011-07-18 12:20:57,275 INFO org.apache.hadoop.ipc.HBaseServer: IPC
Server 
&amp;gt;&amp;gt; handler 5 on 60000: exiting 
&amp;gt;&amp;gt; 2011-07-18 12:20:57,275 INFO org.apache.hadoop.ipc.HBaseServer: IPC
Server 
&amp;gt;&amp;gt; handler 4 on 60000: exiting 
&amp;gt;&amp;gt; 2011-07-18 12:20:57,275 INFO org.apache.hadoop.ipc.HBaseServer: Stopping

&amp;gt;&amp;gt; IPC 
&amp;gt;&amp;gt; Server listener on 60000 
&amp;gt;&amp;gt; 
&amp;gt;&amp;gt; Thanks in advance, 
&amp;gt;&amp;gt; 
&amp;gt;&amp;gt; Regards 
&amp;gt;&amp;gt; Shanmuganathan 
&amp;gt;&amp;gt; 
&amp;gt;&amp;gt; 
&amp;gt; 
&amp;gt; 
&amp;gt; -- 
&amp;gt; Laurent HATIER 
&amp;gt; Étudiant en 2e année du Cycle Ingénieur à l'EISTI 
&amp;gt; 
 
 
 
-- 
Best wishes 
Gan, Xiyun 
 
 



Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message