hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arul Ramachandran <arkup...@gmail.com>
Subject Re: Offheap config question for Hbase 1.1.2
Date Tue, 12 Sep 2017 16:50:21 GMT
Ted,

For #1, I was following:

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_data-access/content/ch_managing-hbase.html#ref-db219cd6-c586-49c1-bc56-c9c1c5475276.1

++

For #2, I got the error "Caused by: java.lang.OutOfMemoryError: Direct
buffer memory" when starting hbase master.

https://community.hortonworks.com/questions/129825/hbase-bucket-cache-causing-hmaster-to-go-down.html

describes the fix.

++

On Tue, Sep 12, 2017 at 9:10 AM, Ted Yu <yuzhihong@gmail.com> wrote:

> Looks like the config you meant should be hbase.bucketcache.size
>
> As the refguide says:
>
> A float that EITHER represents a percentage of total heap memory size to
> give to the cache (if < 1.0) OR, it is the total capacity in megabytes of
> BucketCache. Default: 0.0
>
> If you specify the size as capacity, -XX:MaxDirectMemorySize should be
> bigger than the capacity.
>
> For #2, did you encounter some error ?
>
> Cheers
>
> On Tue, Sep 12, 2017 at 8:52 AM, Arul Ramachandran <arkuppai@gmail.com>
> wrote:
>
> > In HBase 1.1.2, I am setting up bucket cache. I set MaxDirectMemory size
> > greater than hbase.bucket.cache.size  - only then it would work.
> >
> > 1) Does HBASE_REGIONSERVER_OPTS -XX:MaxDirectMemorySize needs to be
> greater
> > than hbase.bucket.cache.size?
> > 2) It seems with hbase 1.1.2, HBASE_MASTER_OPTS also needs the
> >  -XX:MaxDirectMemorySize setting?
> >
> > IIRC, in Hbase 0.98, I had to set -XX:MaxDirectMemorySize less than
> > hbase.bucket.cache.size --and-- I did not have to set
> >  -XX:MaxDirectMemorySize for HBASE_MASTER_OPTS.
> >
> >
> > Thanks,
> > Arul
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message