hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "wei.zhang (JIRA)" <j...@apache.org>
Subject [jira] Created: (HBASE-2900) HBase Out of Memory when the java client connect to the hbase server first time
Date Thu, 05 Aug 2010 01:42:17 GMT
HBase Out of Memory when the java client connect to the hbase server first time
-------------------------------------------------------------------------------

                 Key: HBASE-2900
                 URL: https://issues.apache.org/jira/browse/HBASE-2900
             Project: HBase
          Issue Type: Bug
          Components: ipc
    Affects Versions: 0.20.5
         Environment: Linux Ubuntu
jdk1.6.0_21
hadoop-0.20.2 
Pseudo-Distributed mode for hadoop and hbase
            Reporter: wei.zhang


I installed the hbase and hadoop under the Pseudo-Distributed mode:

I configure the server side with following configuration:

hadoop: core-site.xml
<property>
    <name>fs.default.name</name>
    <value>hdfs://cluster1.office:9000</value>
  </property>

hadoop:mapred-site.xml
<property>
    <name>mapred.job.tracker</name>
    <value>localhost:9001</value>
  </property>

hadoop:hdfs-site.xml
  <property>
    <name>dfs.replication</name>
    <value>1</value>
  </property>

hbase:hbase-site.xml
 <property>
    <name>hbase.rootdir</name>
    <value>hdfs://cluster1.office:9000/hbase</value>
    <description>The directory shared by region servers.
    </description>
  </property>

I configure my client side(this is not in the same server as the server side) with following
configuration:
  <property>
    <name>hbase.rootdir</name>
    <value>hdfs://cluster1.office/hbase</value>
  </property>
  <property>
    <name>hbase.zookeeper.quorum</name>
    <value>cluster1.office</value>
  </property>

And then I connect to server side by java API described in the following page:
http://hbase.apache.org/docs/cur ... package_description

Unfortunately I get the Out of memory error:

2010-08-04 17:57:49,636 INFO org.apache.hadoop.hbase.regionserver.HRegion: Starting compaction
on region -ROOT-,,0
2010-08-04 17:57:49,686 INFO org.apache.hadoop.hbase.master.ServerManager: 1 region servers,
0 dead, average load 4.0
2010-08-04 17:57:49,815 DEBUG org.apache.hadoop.hbase.regionserver.Store: Compaction size
of info: 4.0k; Skipped 1 file(s), size: 1849
2010-08-04 17:57:49,815 INFO org.apache.hadoop.hbase.regionserver.Store: Started compaction
of 4 file(s) in info of -ROOT-,,0  into /hbase/-ROOT-/compaction.dir/70236052, seqid=112
2010-08-04 17:57:49,921 INFO org.apache.hadoop.hbase.regionserver.Store: Completed compaction
of 4 file(s) in info of -ROOT-,,0; new storefile is hdfs://cluster1.jsw.office:9000/hbase/-ROOT-/70236052/info/1636337967443011476;
store size is 3.0k
2010-08-04 17:57:49,926 INFO org.apache.hadoop.hbase.regionserver.HRegion: compaction completed
on region -ROOT-,,0 in 0sec
2010-08-04 17:57:49,926 INFO org.apache.hadoop.hbase.regionserver.HRegion: Starting compaction
on region .META.,,1
2010-08-04 17:57:49,928 DEBUG org.apache.hadoop.hbase.regionserver.Store: historian: no store
files to compact
2010-08-04 17:57:49,937 DEBUG org.apache.hadoop.hbase.regionserver.Store: Compaction size
of info: 5.5k; Skipped 0 file(s), size: 0
2010-08-04 17:57:49,937 INFO org.apache.hadoop.hbase.regionserver.Store: Started compaction
of 5 file(s) in info of .META.,,1  into /hbase/.META./compaction.dir/1028785192, seqid=116
2010-08-04 17:57:50,000 INFO org.apache.hadoop.hbase.master.BaseScanner: RegionManager.rootScanner
scanning meta region {server: 192.168.1.81:39859, regionname: -ROOT-,,0, startKey: <>}
2010-08-04 17:57:50,037 INFO org.apache.hadoop.hbase.regionserver.Store: Completed compaction
of 5 file(s) in info of .META.,,1; new storefile is hdfs://cluster1.jsw.office:9000/hbase/.META./1028785192/info/254940474272935789;
store size is 4.0k
2010-08-04 17:57:50,045 INFO org.apache.hadoop.hbase.regionserver.HRegion: compaction completed
on region .META.,,1 in 0sec
2010-08-04 17:57:50,053 INFO org.apache.hadoop.hbase.master.BaseScanner: RegionManager.rootScanner
scan of 1 row(s) of meta region {server: 192.168.1.81:39859, regionname: -ROOT-,,0, startKey:
<>} complete
2010-08-04 17:57:57,278 FATAL org.apache.hadoop.hbase.regionserver.HRegionServer: OutOfMemoryError,
aborting.
java.lang.OutOfMemoryError: Java heap space
        at org.apache.hadoop.hbase.ipc.HBaseRPC$Invocation.readFields(HBaseRPC.java:175)
        at org.apache.hadoop.hbase.ipc.HBaseServer$Connection.processData(HBaseServer.java:867)
        at org.apache.hadoop.hbase.ipc.HBaseServer$Connection.readAndProcess(HBaseServer.java:835)
        at org.apache.hadoop.hbase.ipc.HBaseServer$Listener.doRead(HBaseServer.java:419)
        at org.apache.hadoop.hbase.ipc.HBaseServer$Listener.run(HBaseServer.java:318)
2010-08-04 17:57:57,279 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: Dump of metrics:
request=0.0, regions=4, stores=5, storefiles=4, storefileIndexSize=0, memstoreSize=0, compactionQueueSize=0,
usedHeap=23, maxHeap=695, blockCacheSize=1208688, blockCacheFree=144726880, blockCacheCount=11,
blockCacheHitRatio=82, fsReadLatency=0, fsWriteLatency=0, fsSyncLatency=0
2010-08-04 17:57:57,279 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server listener on 39859:
exiting on OOME
2010-08-04 17:57:57,793 INFO org.apache.hadoop.ipc.HBaseServer: Stopping server on 39859
2010-08-04 17:57:57,794 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 24 on 39859:
exiting
2010-08-04 17:57:57,794 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 0 on 39859:
exiting
2010-08-04 17:57:57,794 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 2 on 39859:
exiting
2010-08-04 17:57:57,794 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 20 on 39859:
exiting
2010-08-04 17:57:57,795 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 21 on 39859:
exiting
2010-08-04 17:57:57,795 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: Stopping
infoServer
2010-08-04 17:57:57,796 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 1 on 39859:
exiting
2010-08-04 17:57:57,796 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 3 on 39859:
exiting
2010-08-04 17:57:57,796 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 4 on 39859:
exiting

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message