hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: hfile.bucket.BucketAllocatorException: Allocation too big size
Date Mon, 01 Jun 2015 14:59:01 GMT
Dejan:
"hbase.bucketcache.bucket.sizes" was introduced by:
HBASE-10641 Configurable Bucket Sizes in bucketCache

which was integrated to 0.98.4

HDP 2.2 has the fix while HDP 2.1 didn't.

FYI

On Mon, Jun 1, 2015 at 7:23 AM, Dejan Menges <dejan.menges@gmail.com> wrote:

> Hi Ted,
>
> It's 0.98.0 with bunch of patches (from Hortonworks).
>
> Let me try with that key, on my way :)
>
> On Mon, Jun 1, 2015 at 4:19 PM Ted Yu <yuzhihong@gmail.com> wrote:
>
> > Which hbase release are you using ?
> >
> > I seem to recall that hbase.bucketcache.bucket.sizes was the key.
> >
> > Cheers
> >
> > On Mon, Jun 1, 2015 at 7:04 AM, Dejan Menges <dejan.menges@gmail.com>
> > wrote:
> >
> > > Hi,
> > >
> > > I'm getting messages like:
> > >
> > > 015-06-01 14:02:29,529 WARN
> > > org.apache.hadoop.hbase.io.hfile.bucket.BucketCache: Failed allocating
> > for
> > > block ce18012f4dfa424db88e92de29e76a9b_25809098330
> > >
> > > org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocatorException:
> > > Allocation too big size=750465
> > >
> > > at
> > >
> > > org.apache.hadoop.hbase.io
> > .hfile.bucket.BucketAllocator.allocateBlock(BucketAllocator.java:400)
> > >
> > > at
> > >
> > > org.apache.hadoop.hbase.io
> >
> .hfile.bucket.BucketCache$RAMQueueEntry.writeToCache(BucketCache.java:1153)
> > >
> > > at
> > >
> > > org.apache.hadoop.hbase.io
> > .hfile.bucket.BucketCache$WriterThread.doDrain(BucketCache.java:703)
> > >
> > > at
> > >
> > > org.apache.hadoop.hbase.io
> > .hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:675)
> > >
> > > at java.lang.Thread.run(Thread.java:745)
> > >
> > >
> > > However, not sure why is this. If I understood it correctly (and
> > probably I
> > > didn't :/) this should fit in one of those:
> > >
> > >    <property>
> > >
> > >    <name>hbase.bucketcache.sizes</name>
> > >
> > >  <value>65536,131072,196608,262144,327680,393216,655360,1310720</value>
> > >
> > > </property>
> > >
> > > In the same time, hbase,bucketcache.size is 24G. Not sure what I did
> > > (again) wrong?
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message