Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (nike.apache.org: domain of jdcryans@gmail.com designates
 209.85.210.41 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:sender:in-reply-to:references:date
         :x-google-sender-auth:message-id:subject:from:to:cc:content-type
         :content-transfer-encoding;
        b=cT6ZjMohSoL5MRtKCSaQ2gwBa6lv/lVk4rNARmI6M4j0EBxzQCK8ifXhWphEsnwP42
         kmYNg/JWIQabMoq2AdvTWSw2LjxDotH25S75mDO5qvNA+BIO4KreUbtXNl9QlxsKGAdV
         FW5giuMxRH2+7eRSIlxdum0iTd6qfkEEJGoTE=
MIME-Version: 1.0
Sender: jdcryans@gmail.com
In-Reply-To: <BANLkTi=++NAwjJ2U2eq=+_b7eoqN5sfY2A@mail.gmail.com>
References: <BANLkTik5cy9WqYdD1fB0SMfD-AV1bCg3hA@mail.gmail.com>
	<BANLkTi=p2b0YxLU0=wTKcFLDZ6ZSQsxSgQ@mail.gmail.com>
	<BANLkTi=++NAwjJ2U2eq=+_b7eoqN5sfY2A@mail.gmail.com>
Date: Mon, 11 Apr 2011 17:43:52 -0700
Message-ID: <BANLkTindQ-gzm9sVjQ54LU3-m8wbdX9Mow@mail.gmail.com>
Subject: Re: too many regions cause OME ?
From: Jean-Daniel Cryans <jdcryans@apache.org>
To: user@hbase.apache.org
Cc: =?UTF-8?B?6ZmI5Yqg5L+K?= <cjjvictory@gmail.com>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

And where will they go? The issue isn't the number of regions per say,
it's the amount of data being served by that region server. Also I
still don't know if that's really your issue or it's a configuration
issue (which I have yet to see).

J-D

On Mon, Apr 11, 2011 at 5:41 PM, =E9=99=88=E5=8A=A0=E4=BF=8A <cjjvictory@gm=
ail.com> wrote:
> Can I limit the numbers of regions =C2=A0on one RegionServer ?
>
> On Tue, Apr 12, 2011 at 8:37 AM, Jean-Daniel Cryans <jdcryans@apache.org>=
wrote:
>
>> It's really a lot yes, but it could also be weird configurations or
>> too big values.
>>
>> J-D
>>
>> On Mon, Apr 11, 2011 at 5:35 PM, =E9=99=88=E5=8A=A0=E4=BF=8A <cjjvictory=
@gmail.com> wrote:
>> > Is it too many regions ? Is the memory enough ?
>> > HBase-0.20.6
>> >
>> > 2011-04-12 00:16:31,844 FATAL
>> > org.apache.hadoop.hbase.regionserver.HRegionServer: OutOfMemoryError,
>> > aborting.
>> > java.lang.OutOfMemoryError: Java heap space
>> > =C2=A0 =C2=A0 =C2=A0 =C2=A0at
>> java.io.BufferedInputStream.<init>(BufferedInputStream.java:178)
>> > =C2=A0 =C2=A0 =C2=A0 =C2=A0at
>> >
>> org.apache.hadoop.hdfs.DFSClient$BlockReader.newBlockReader(DFSClient.ja=
va:1380)
>> > =C2=A0 =C2=A0 =C2=A0 =C2=A0at
>> >
>> org.apache.hadoop.hdfs.DFSClient$DFSInputStream.blockSeekTo(DFSClient.ja=
va:1648)
>> > =C2=A0 =C2=A0 =C2=A0 =C2=A0at
>> > org.apache.hadoop.hdfs.DFSClient$DFSInputStream.read(DFSClient.java:17=
67)
>> > =C2=A0 =C2=A0 =C2=A0 =C2=A0at java.io.DataInputStream.readFully(DataIn=
putStream.java:178)
>> > =C2=A0 =C2=A0 =C2=A0 =C2=A0at java.io.DataInputStream.readFully(DataIn=
putStream.java:152)
>> > =C2=A0 =C2=A0 =C2=A0 =C2=A0at
>> >
>> org.apache.hadoop.hbase.io.hfile.HFile$FixedFileTrailer.deserialize(HFil=
e.java:1368)
>> > =C2=A0 =C2=A0 =C2=A0 =C2=A0at
>> > org.apache.hadoop.hbase.io.hfile.HFile$Reader.readTrailer(HFile.java:8=
48)
>> > =C2=A0 =C2=A0 =C2=A0 =C2=A0at
>> >
>> org.apache.hadoop.hbase.io.hfile.HFile$Reader.loadFileInfo(HFile.java:79=
3)
>> > =C2=A0 =C2=A0 =C2=A0 =C2=A0at
>> > org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:273=
)
>> > =C2=A0 =C2=A0 =C2=A0 =C2=A0at
>> > org.apache.hadoop.hbase.regionserver.StoreFile.<init>(StoreFile.java:1=
29)
>> > =C2=A0 =C2=A0 =C2=A0 =C2=A0at
>> > org.apache.hadoop.hbase.regionserver.Store.loadStoreFiles(Store.java:4=
10)
>> > =C2=A0 =C2=A0 =C2=A0 =C2=A0at
>> org.apache.hadoop.hbase.regionserver.Store.<init>(Store.java:221)
>> > =C2=A0 =C2=A0 =C2=A0 =C2=A0at
>> >
>> org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.j=
ava:1636)
>> > =C2=A0 =C2=A0 =C2=A0 =C2=A0at
>> > org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:3=
21)
>> > =C2=A0 =C2=A0 =C2=A0 =C2=A0at
>> >
>> org.apache.hadoop.hbase.regionserver.HRegionServer.instantiateRegion(HRe=
gionServer.java:1566)
>> > =C2=A0 =C2=A0 =C2=A0 =C2=A0at
>> >
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openRegion(HRegionSer=
ver.java:1533)
>> > =C2=A0 =C2=A0 =C2=A0 =C2=A0at
>> >
>> org.apache.hadoop.hbase.regionserver.HRegionServer$Worker.run(HRegionSer=
ver.java:1453)
>> > =C2=A0 =C2=A0 =C2=A0 =C2=A0at java.lang.Thread.run(Thread.java:619)
>> > 2011-04-12 00:16:31,847 INFO
>> > org.apache.hadoop.hbase.regionserver.HRegionServer: Dump of metrics:
>> > request=3D0.0, regions=3D1624, stores=3D3075, storefiles=3D2526,
>> > storefileIndexSize=3D374, memstoreSize=3D339, compactionQueueSize=3D0,
>> > usedHeap=3D3990, maxHeap=3D3991, blockCacheSize=3D706107016,
>> > blockCacheFree=3D131010552, blockCacheCount=3D10631, blockCacheHitRati=
o=3D58,
>> > fsReadLatency=3D0, fsWriteLatency=3D0, fsSyncLatency=3D0
>> > 2011-04-12 00:16:31,848 INFO
>> > org.apache.hadoop.hbase.regionserver.HRegionServer: worker thread exit=
ing
>> >
>> >
>> > --
>> > Thanks & Best regards
>> > jiajun
>> >
>>
>
>
>
> --
> Thanks & Best regards
> jiajun
>