hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dejan Menges <dejan.men...@gmail.com>
Subject Re: hfile.bucket.BucketAllocatorException: Allocation too big size
Date Mon, 01 Jun 2015 15:06:19 GMT
Oh, cool, something that will push us to upgrade sooner than later :)

Just for my information - what limit was used than in 2.1 as maximum cache
block size (or whatever name it was)? Size of the block, or something else?

On Mon, Jun 1, 2015 at 5:00 PM Ted Yu <yuzhihong@gmail.com> wrote:

> Dejan:
> "hbase.bucketcache.bucket.sizes" was introduced by:
> HBASE-10641 Configurable Bucket Sizes in bucketCache
>
> which was integrated to 0.98.4
>
> HDP 2.2 has the fix while HDP 2.1 didn't.
>
> FYI
>
> On Mon, Jun 1, 2015 at 7:23 AM, Dejan Menges <dejan.menges@gmail.com>
> wrote:
>
> > Hi Ted,
> >
> > It's 0.98.0 with bunch of patches (from Hortonworks).
> >
> > Let me try with that key, on my way :)
> >
> > On Mon, Jun 1, 2015 at 4:19 PM Ted Yu <yuzhihong@gmail.com> wrote:
> >
> > > Which hbase release are you using ?
> > >
> > > I seem to recall that hbase.bucketcache.bucket.sizes was the key.
> > >
> > > Cheers
> > >
> > > On Mon, Jun 1, 2015 at 7:04 AM, Dejan Menges <dejan.menges@gmail.com>
> > > wrote:
> > >
> > > > Hi,
> > > >
> > > > I'm getting messages like:
> > > >
> > > > 015-06-01 14:02:29,529 WARN
> > > > org.apache.hadoop.hbase.io.hfile.bucket.BucketCache: Failed
> allocating
> > > for
> > > > block ce18012f4dfa424db88e92de29e76a9b_25809098330
> > > >
> > > > org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocatorException:
> > > > Allocation too big size=750465
> > > >
> > > > at
> > > >
> > > > org.apache.hadoop.hbase.io
> > > .hfile.bucket.BucketAllocator.allocateBlock(BucketAllocator.java:400)
> > > >
> > > > at
> > > >
> > > > org.apache.hadoop.hbase.io
> > >
> >
> .hfile.bucket.BucketCache$RAMQueueEntry.writeToCache(BucketCache.java:1153)
> > > >
> > > > at
> > > >
> > > > org.apache.hadoop.hbase.io
> > > .hfile.bucket.BucketCache$WriterThread.doDrain(BucketCache.java:703)
> > > >
> > > > at
> > > >
> > > > org.apache.hadoop.hbase.io
> > > .hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:675)
> > > >
> > > > at java.lang.Thread.run(Thread.java:745)
> > > >
> > > >
> > > > However, not sure why is this. If I understood it correctly (and
> > > probably I
> > > > didn't :/) this should fit in one of those:
> > > >
> > > >    <property>
> > > >
> > > >    <name>hbase.bucketcache.sizes</name>
> > > >
> > > >
> <value>65536,131072,196608,262144,327680,393216,655360,1310720</value>
> > > >
> > > > </property>
> > > >
> > > > In the same time, hbase,bucketcache.size is 24G. Not sure what I did
> > > > (again) wrong?
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message