hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: Using snappy compression with standalone HBase ?
Date Tue, 03 Oct 2017 17:27:12 GMT
bq. org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z

The method is defined
in hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/NativeCodeLoader.java

Which release of hbase did you deploy ?

Which hadoop jars are under lib dir ?

Thanks

On Tue, Oct 3, 2017 at 10:21 AM, schausson <schausson@softera.fr> wrote:

> Hi,
> I'm experimenting with HBase on a brand new linux VM (ubuntu), as a
> standalone installation (I don't have any hadoop distribution on my VM,
> it's
> worth saying it). I would like to test compression options, but couldn't
> figure out how to make it working :
> I manually installed snappy stuff (apt-get install libsnappy1v5
> libsnappy-dev), so the library is there, but how to point to it ?
>
> I figured out that following command "hbase --config ~/conf_hbase
> org.apache.hadoop.util.NativeLibraryChecker" exclusively relies on hadoop
> and doesn't display compression libraries even if they have been installed.
>
> I set HBASE_LIBRARY_PATH=/usr/lib/x86_64-linux-gnu/ (where snappy .so
> files
> are located) and gave a try to "hbase
> org.apache.hadoop.hbase.util.CompressionTest
> /path/to/my/file/on/local/filesystem snappy", but faced following
> exception
> :
> Exception in thread "main" java.lang.UnsatisfiedLinkError:
> org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z
>         at org.apache.hadoop.util.NativeCodeLoader.
> buildSupportsSnappy(Native
> Method)
>         at
> org.apache.hadoop.io.compress.SnappyCodec.checkNativeCodeLoaded(
> SnappyCodec.java:63)
>         at
> org.apache.hadoop.io.compress.SnappyCodec.getCompressorType(
> SnappyCodec.java:132)
>         at
> org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:148)
>
> Did anybody already make this work together ?
> Thanks for your help
>
>
>
>
> --
> Sent from: http://apache-hbase.679495.n3.nabble.com/HBase-User-
> f4020416.html
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message