Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (nike.apache.org: domain of cjjvictory@gmail.com designates
 209.85.160.41 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :cc:content-type;
        b=Jl9X6/FZj4jqpnm9OaDNhZlGFacd57t1EtLTp3DTaaHRi2W9CKYatquevMHuchgseO
         4pA+swx+K8/Kz7FSNP3UDWN25syFlpsxkH0jMiTnIvP40SFwtfKpECr4uvFLkmqgfosZ
         CenBkwEHxn7mf0XUQSs1fIEOv/PHvOeMRMHek=
MIME-Version: 1.0
In-Reply-To: <BANLkTinb=aFs8KyNx+Ab2qDTkr27Bjd2SQ@mail.gmail.com>
References: <BANLkTik5cy9WqYdD1fB0SMfD-AV1bCg3hA@mail.gmail.com>
	<BANLkTi=p2b0YxLU0=wTKcFLDZ6ZSQsxSgQ@mail.gmail.com>
	<BANLkTi=++NAwjJ2U2eq=+_b7eoqN5sfY2A@mail.gmail.com>
	<BANLkTindQ-gzm9sVjQ54LU3-m8wbdX9Mow@mail.gmail.com>
	<BANLkTikpsjbx6kjZARrNux9OpLfPRbj1jw@mail.gmail.com>
	<BANLkTimi6gRb3fewBTgz23iauWjHfp=PoQ@mail.gmail.com>
	<BANLkTi=tsm2gyWpErVD+QAqep4GL3Z+9mA@mail.gmail.com>
	<BANLkTinb=aFs8KyNx+Ab2qDTkr27Bjd2SQ@mail.gmail.com>
Date: Tue, 12 Apr 2011 12:42:06 +0800
Message-ID: <BANLkTing0eV_1X0Tn+ac_NgOUD9_B8-e_w@mail.gmail.com>
Subject: Re: too many regions cause OME ?
From: =?UTF-8?B?6ZmI5Yqg5L+K?= <cjjvictory@gmail.com>
To: Jean-Daniel Cryans <jdcryans@apache.org>
Cc: user@hbase.apache.org
Content-Type: multipart/alternative; boundary=001636e1fbaf7a40b404a0b15032

--001636e1fbaf7a40b404a0b15032
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Yes ,I scan (or get or put)  rows always .

On Tue, Apr 12, 2011 at 10:49 AM, Jean-Daniel Cryans <jdcryans@apache.org>w=
rote:

> Were they opening the same region by any chance?
>
> On Mon, Apr 11, 2011 at 6:13 PM, =E9=99=88=E5=8A=A0=E4=BF=8A <cjjvictory@=
gmail.com> wrote:
> > There is no big scan,and just norma load. Also strange is when one RS
> exited
> > then another RS exited and others RS like that.
> >
> > On Tue, Apr 12, 2011 at 8:55 AM, Jean-Daniel Cryans <jdcryans@apache.or=
g
> >wrote:
> >
> >> Ok that looks "fine", did the region server die under heavy load by
> >> any chance? Or was it big scans? Or just normal load?
> >>
> >> J-D
> >>
> >> On Mon, Apr 11, 2011 at 5:50 PM, =E9=99=88=E5=8A=A0=E4=BF=8A <cjjvicto=
ry@gmail.com> wrote:
> >> > my configuration is follows:
> >> >  <property>
> >> >                 <name>hbase.client.write.buffer</name>
> >> >                 <value>2097152</value>
> >> >                 <description>
> >> >                         1024*1024*2=3D2097152
> >> >                 </description>
> >> >         </property>
> >> >         <property>
> >> >                 <name>hbase.hstore.blockingStoreFiles</name>
> >> >                 <value>14</value>
> >> >         </property>
> >> >         <property>
> >> >                 <name>hbase.hregion.memstore.block.multiplier</name>
> >> >                 <value>2</value>
> >> >         </property>
> >> >         <property>
> >> >                 <name>hbase.regionserver.handler.count</name>
> >> >                 <value>30</value>
> >> >         </property>
> >> >  <property>
> >> >                 <name>zookeeper.session.timeout</name>
> >> >                 <value>90000</value>
> >> >         </property>
> >> >         <property>
> >> >                  <name>hbase.zookeeper.property.tickTime</name>
> >> >                  <value>9000</value>
> >> >         </property>
> >> >         <property>
> >> >                  <name>hbase.hregion.max.filesize</name>
> >> >                  <value>1073741824</value>
> >> >                 <description>
> >> >                 Maximum HStoreFile size. If any one of a column
> families'
> >> > HStoreFiles has grown to exceed this value,
> >> >                 the hosting HRegion is split in two. Default: 256M.
> >> >                 1024*1024*1024=3D1073741824 (1G)
> >> >                 </description>
> >> >         </property>
> >> >
> >> > On Tue, Apr 12, 2011 at 8:43 AM, Jean-Daniel Cryans <
> jdcryans@apache.org
> >> >
> >> > wrote:
> >> >>
> >> >> And where will they go? The issue isn't the number of regions per
> say,
> >> >> it's the amount of data being served by that region server. Also I
> >> >> still don't know if that's really your issue or it's a configuratio=
n
> >> >> issue (which I have yet to see).
> >> >>
> >> >> J-D
> >> >>
> >> >> On Mon, Apr 11, 2011 at 5:41 PM, =E9=99=88=E5=8A=A0=E4=BF=8A <cjjvi=
ctory@gmail.com> wrote:
> >> >> > Can I limit the numbers of regions  on one RegionServer ?
> >> >> >
> >> >> > On Tue, Apr 12, 2011 at 8:37 AM, Jean-Daniel Cryans
> >> >> > <jdcryans@apache.org>wrote:
> >> >> >
> >> >> >> It's really a lot yes, but it could also be weird configurations
> or
> >> >> >> too big values.
> >> >> >>
> >> >> >> J-D
> >> >> >>
> >> >> >> On Mon, Apr 11, 2011 at 5:35 PM, =E9=99=88=E5=8A=A0=E4=BF=8A <cj=
jvictory@gmail.com>
> wrote:
> >> >> >> > Is it too many regions ? Is the memory enough ?
> >> >> >> > HBase-0.20.6
> >> >> >> >
> >> >> >> > 2011-04-12 00:16:31,844 FATAL
> >> >> >> > org.apache.hadoop.hbase.regionserver.HRegionServer:
> >> OutOfMemoryError,
> >> >> >> > aborting.
> >> >> >> > java.lang.OutOfMemoryError: Java heap space
> >> >> >> >        at
> >> >> >> java.io.BufferedInputStream.<init>(BufferedInputStream.java:178)
> >> >> >> >        at
> >> >> >> >
> >> >> >>
> >> >> >>
> >>
> org.apache.hadoop.hdfs.DFSClient$BlockReader.newBlockReader(DFSClient.jav=
a:1380)
> >> >> >> >        at
> >> >> >> >
> >> >> >>
> >> >> >>
> >>
> org.apache.hadoop.hdfs.DFSClient$DFSInputStream.blockSeekTo(DFSClient.jav=
a:1648)
> >> >> >> >        at
> >> >> >> >
> >> >> >> >
> >>
> org.apache.hadoop.hdfs.DFSClient$DFSInputStream.read(DFSClient.java:1767)
> >> >> >> >        at
> >> java.io.DataInputStream.readFully(DataInputStream.java:178)
> >> >> >> >        at
> >> java.io.DataInputStream.readFully(DataInputStream.java:152)
> >> >> >> >        at
> >> >> >> >
> >> >> >>
> >> >> >>
> >>
> org.apache.hadoop.hbase.io.hfile.HFile$FixedFileTrailer.deserialize(HFile=
.java:1368)
> >> >> >> >        at
> >> >> >> >
> >> >> >> >
> >>
> org.apache.hadoop.hbase.io.hfile.HFile$Reader.readTrailer(HFile.java:848)
> >> >> >> >        at
> >> >> >> >
> >> >> >>
> >> >> >>
> >>
> org.apache.hadoop.hbase.io.hfile.HFile$Reader.loadFileInfo(HFile.java:793=
)
> >> >> >> >        at
> >> >> >> >
> >> >> >> >
> >> org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:273=
)
> >> >> >> >        at
> >> >> >> >
> >> >> >> >
> >>
> org.apache.hadoop.hbase.regionserver.StoreFile.<init>(StoreFile.java:129)
> >> >> >> >        at
> >> >> >> >
> >> >> >> >
> >>
> org.apache.hadoop.hbase.regionserver.Store.loadStoreFiles(Store.java:410)
> >> >> >> >        at
> >> >> >> org.apache.hadoop.hbase.regionserver.Store.<init>(Store.java:221=
)
> >> >> >> >        at
> >> >> >> >
> >> >> >>
> >> >> >>
> >>
> org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.ja=
va:1636)
> >> >> >> >        at
> >> >> >> >
> >> >> >> >
> >>
> org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:321)
> >> >> >> >        at
> >> >> >> >
> >> >> >>
> >> >> >>
> >>
> org.apache.hadoop.hbase.regionserver.HRegionServer.instantiateRegion(HReg=
ionServer.java:1566)
> >> >> >> >        at
> >> >> >> >
> >> >> >>
> >> >> >>
> >>
> org.apache.hadoop.hbase.regionserver.HRegionServer.openRegion(HRegionServ=
er.java:1533)
> >> >> >> >        at
> >> >> >> >
> >> >> >>
> >> >> >>
> >>
> org.apache.hadoop.hbase.regionserver.HRegionServer$Worker.run(HRegionServ=
er.java:1453)
> >> >> >> >        at java.lang.Thread.run(Thread.java:619)
> >> >> >> > 2011-04-12 00:16:31,847 INFO
> >> >> >> > org.apache.hadoop.hbase.regionserver.HRegionServer: Dump of
> >> metrics:
> >> >> >> > request=3D0.0, regions=3D1624, stores=3D3075, storefiles=3D252=
6,
> >> >> >> > storefileIndexSize=3D374, memstoreSize=3D339, compactionQueueS=
ize=3D0,
> >> >> >> > usedHeap=3D3990, maxHeap=3D3991, blockCacheSize=3D706107016,
> >> >> >> > blockCacheFree=3D131010552, blockCacheCount=3D10631,
> >> >> >> > blockCacheHitRatio=3D58,
> >> >> >> > fsReadLatency=3D0, fsWriteLatency=3D0, fsSyncLatency=3D0
> >> >> >> > 2011-04-12 00:16:31,848 INFO
> >> >> >> > org.apache.hadoop.hbase.regionserver.HRegionServer: worker
> thread
> >> >> >> > exiting
> >> >> >> >
> >> >> >> >
> >> >> >> > --
> >> >> >> > Thanks & Best regards
> >> >> >> > jiajun
> >> >> >> >
> >> >> >>
> >> >> >
> >> >> >
> >> >> >
> >> >> > --
> >> >> > Thanks & Best regards
> >> >> > jiajun
> >> >> >
> >> >
> >> >
> >> >
> >> > --
> >> > Thanks & Best regards
> >> > jiajun
> >> >
> >> >
> >>
> >
> >
> >
> > --
> > Thanks & Best regards
> > jiajun
> >
>


--=20
Thanks & Best regards
jiajun

--001636e1fbaf7a40b404a0b15032--