hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Daniel Jeliński <djelins...@gmail.com>
Subject Re: OutOfMemoryError: Direct buffer memory on PUT
Date Tue, 10 Oct 2017 06:39:01 GMT
Sudhir,
Not on the cluster in question. It's still configured to use HFile v2, and
as far as I can tell, this is not a setting you could override on a table
level.
Thanks,
Daniel

2017-10-10 0:16 GMT+02:00 sudhir patil <spatil.sudhir@gmail.com>:

> If your cell size is greater than 100KB its recommended to use MOB's
> https://www.cloudera.com/documentation/enterprise/5-4-
> x/topics/admin_hbase_mob.html,
> can you give it a try?
>
> On Tue, Oct 10, 2017 at 1:41 AM, Ted Yu <yuzhihong@gmail.com> wrote:
>
> > Daniel:
> > Does the version you use contain HBASE-13819 ?
> >
> > Cheers
> >
> > On Mon, Oct 9, 2017 at 2:12 AM, Daniel Jeliński <djelinski1@gmail.com>
> > wrote:
> >
> > > Hello,
> > > I'm running an application doing a lot of Puts (size anywhere between 0
> > and
> > > 10MB, one cell at a time); occasionally I'm getting an error like the
> > > below:
> > > 2017-10-09 04:29:29,811 WARN  [AsyncProcess] - #13368,
> > > table=researchplatform:repo_stripe, attempt=1/1 failed=1ops, last
> > > exception: java.io.IOException: com.google.protobuf.ServiceException:
> > > java.lang.OutOfMemoryError: Direct buffer memory on
> > > c169dzv.int.westgroup.com,60020,1506476748534, tracking started Mon
> Oct
> > 09
> > > 04:29:29 EDT 2017; not retrying 1 - final failure
> > >
> > > After that the connection to RegionServer becomes unusable. Every
> > > subsequent attempt to execute Put on that connection results in
> > > CallTimeoutException. I only found the OutOfMemory by reducing the
> number
> > > of tries to 1.
> > >
> > > The host running HBase appears to have at least a few GB of free memory
> > > available. Server logs do not mention anything about this error.
> Cluster
> > is
> > > running HBase 1.2.0-cdh5.10.2.
> > >
> > > Is this a known problem? Are there workarounds available?
> > > Thanks,
> > > Daniel
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message