hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Daniel Cryans <jdcry...@apache.org>
Subject Re: running out of memory. Reasons?
Date Mon, 27 Sep 2010 19:42:53 GMT
I'd say it's the:

2010-09-27 12:16:15,291 INFO
org.apache.hadoop.hbase.regionserver.Store: Started compaction of 943
file(s) in att of
img833,dsc03711s.jpg,1285493435306.da57612ee69d7baaefe84
eeb0e49f240.  into
hdfs://namenode-rd.imageshack.us:9000/hbase/img833/da57612ee69d7baaefe84eeb0e49f240/.tmp,
sequenceid=618626242

That killed you. I wonder how it was able to get there since the
Memstore blocks flushing if the upper threshold for compactions was
reached (default is 7, did you set it to 1000 by any chance?).

J-D

On Mon, Sep 27, 2010 at 12:29 PM, Jack Levin <magnito@gmail.com> wrote:
> Strange situation, cold start the cluster, and one of the servers just
> started getting more and more consuming of RAM, you can see it form
> the screenshot I am attaching.  Here is the log:
> http://pastebin.com/MDPJzLQJ
>
> There seem to be nothing happen, and then it just runs out of Memory,
> and of course shuts down.
>
> Here is GC log before the crash:  http://pastebin.com/GwdC3nhx
>
> Strange , that other region servers stay up and consuming little
> memory (or rather stay stable.).
>
> Any ideas?
>
> -Jack
>

Mime
View raw message