hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sandy Pratt <prat...@adobe.com>
Subject RE: problem with LZO compressor on write only loads
Date Tue, 11 Jan 2011 21:15:50 GMT
I'm curious if you've tried -XX:MaxDirectMemorySize=256m (or whatever value).

> -----Original Message-----
> From: Andrey Stepachev [mailto:octo47@gmail.com]
> Sent: Tuesday, January 11, 2011 12:58
> To: user@hbase.apache.org
> Subject: Re: problem with LZO compressor on write only loads
> 
> Not only with LZO, but with regular gzip I got the same issue (on sun and
> jrocket jvm). Looks like some bug for me. Don't know how to beat this bug.
> 
> 2011/1/3 Friso van Vollenhoven <fvanvollenhoven@xebia.com>
> 
> > Hi all,
> >
> > I seem to run into a problem that occurs when using LZO compression on
> > a heavy write only load. I am using 0.90 RC1 and, thus, the LZO
> > compressor code that supports the reinit() method (from Kevin Weil's
> > github, version 0.4.8). There are some more Hadoop LZO incarnations,
> > so I am pointing my question to this list.
> >
> > Thanks,
> > Friso
> >
> >
Mime
View raw message