hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Todd Lipcon <t...@cloudera.com>
Subject Re: Exception reading from Hbase table with LZO compression
Date Thu, 03 Feb 2011 19:25:09 GMT
Hi Ashish,

Which version of the LZO libraries are you using?

-Todd

On Thu, Feb 3, 2011 at 7:46 AM, Ashish Shinde <ashish@strandls.com> wrote:

> Hi,
>
> I get the following exception when reading from a table with LZO
> compression (using a M/R job as well as shell) on hbase 0.90.0.
>
> Is this hbase related of is there a big in hadoop-gpl-compression.
>
> Thanks and regards,
>  - Ashish
>
>
> java.io.IOException: java.io.IOException:
> java.lang.IllegalArgumentException at
>
> org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:988)
> at
>
> org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:976)
> at
>
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1767)
> at sun.reflect.GeneratedMethodAccessor10.invoke(Unknown Source) at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597) at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570) at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1036)
> Caused by: java.lang.IllegalArgumentException at
> java.nio.Buffer.limit(Buffer.java:249) at
>
> com.hadoop.compression.lzo.LzoDecompressor.decompress(LzoDecompressor.java:289)
> at
>
> org.apache.hadoop.io.compress.BlockDecompressorStream.decompress(BlockDecompressorStream.java:74)
> at
>
> org.apache.hadoop.io.compress.DecompressorStream.read(DecompressorStream.java:74)
> at java.io.BufferedInputStream.read1(BufferedInputStream.java:256) at
> java.io.BufferedInputStream.read(BufferedInputStream.java:317) at
> org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:100) at
> org.apache.hadoop.hbase.io.hfile.HFile$Reader.decompress(HFile.java:1094)
> at
> org.apache.hadoop.hbase.io.hfile.HFile$Reader.readBlock(HFile.java:1036)
> at
>
> org.apache.hadoop.hbase.io.hfile.HFile$Reader$Scanner.seekTo(HFile.java:1433)
> at
>
> org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekAtOrAfter(StoreFileScanner.java:139)
> at
>
> org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(Storenner.java:96)
> at
>
> org.apache.hadoop.hbase.regionserver.StoreScanner.<init>(StoreScanner.java:77)
> at
> org.apache.hadoop.hbase.regionserver.Store.getScanner(Store.java:1338)
> at
>
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.<init>(HRegion.java:2229)
> at
>
> org.apache.hadoop.hbase.regionserver.HRegion.instantiateInternalScanner(HRegion.java:1119)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:1111)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:1095)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1765)
> ...
> 5 more
>
>


-- 
Todd Lipcon
Software Engineer, Cloudera

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message