hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-6843) loading lzo error when using coprocessor
Date Mon, 22 Oct 2012 19:42:12 GMT

    [ https://issues.apache.org/jira/browse/HBASE-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13481713#comment-13481713
] 

Andrew Purtell commented on HBASE-6843:
---------------------------------------

bq. Is this the typical lzo compression library folks would use? That would indeed be pretty
bad.

It is, and it is, but {{com.hadoop}} classes are from the Hadoop GPL codec project.

The trivial thing to do here is add them to the whitelist but there are two larger issues
IMHO. The precedent is bad, whitelisting non ASF code. How often will we do this? And anyway
the whitelist should not be hardcoded anyway. At least, it should be extensible.


                
> loading lzo error when using coprocessor
> ----------------------------------------
>
>                 Key: HBASE-6843
>                 URL: https://issues.apache.org/jira/browse/HBASE-6843
>             Project: HBase
>          Issue Type: Bug
>          Components: Coprocessors
>    Affects Versions: 0.94.1
>            Reporter: Zhou wenjian
>            Assignee: Zhou wenjian
>            Priority: Critical
>             Fix For: 0.94.3, 0.96.0
>
>         Attachments: HBASE-6843-trunk.patch
>
>
> After applying HBASE-6308,we found error followed
> 2012-09-06 00:44:38,341 DEBUG org.apache.hadoop.hbase.coprocessor.CoprocessorClassLoader:
Finding class: com.hadoop.compression.lzo.LzoCodec
> 2012-09-06 00:44:38,351 ERROR com.hadoop.compression.lzo.GPLNativeCodeLoader: Could not
load native gpl library
> java.lang.UnsatisfiedLinkError: Native Library /home/zhuzhuang/hbase/0.94.0-ali-1.0/lib/native/Linux-amd64-64/libgplcompression.so
already loaded in another classloade
> r
> at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1772)
> at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1732)
> at java.lang.Runtime.loadLibrary0(Runtime.java:823)
> at java.lang.System.loadLibrary(System.java:1028)
> at com.hadoop.compression.lzo.GPLNativeCodeLoader.<clinit>(GPLNativeCodeLoader.java:32)
> at com.hadoop.compression.lzo.LzoCodec.<clinit>(LzoCodec.java:67)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:113)
> at org.apache.hadoop.hbase.io.hfile.Compression$Algorithm$1.getCodec(Compression.java:107)
> at org.apache.hadoop.hbase.io.hfile.Compression$Algorithm.getCompressor(Compression.java:243)
> at org.apache.hadoop.hbase.util.CompressionTest.testCompression(CompressionTest.java:85)
> at org.apache.hadoop.hbase.regionserver.HRegion.checkCompressionCodecs(HRegion.java:3793)
> at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:3782)
> at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:3732)
> at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:332)
> at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:108)
> at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:169)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> 2012-09-06 00:44:38,355 DEBUG org.apache.hadoop.hbase.coprocessor.CoprocessorClassLoader:
Skipping exempt class java.io.PrintWriter - delegating directly to parent
> 2012-09-06 00:44:38,355 ERROR com.hadoop.compression.lzo.LzoCodec: Cannot load native-lzo
without native-hadoop

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message