hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John Zhuge (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-12972) Lz4Compressor#getLibraryName returns the wrong version number
Date Wed, 30 Mar 2016 07:45:25 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-12972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15217606#comment-15217606
] 

John Zhuge commented on HADOOP-12972:
-------------------------------------

Thanks [~cmccabe] for the fix. Here is the test output of the patch:
{code}
$ hadoop checknative
16/03/30 00:13:19 INFO bzip2.Bzip2Factory: Successfully loaded & initialized native-bzip2
library system-native
16/03/30 00:13:19 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib
library
Native library checking:
hadoop:  true /opt/cloudera/parcels/CDH-5.8.0-1.cdh5.8.0.p0.26/lib/hadoop/lib/native/libhadoop.so.1.0.0
zlib:    true /lib/x86_64-linux-gnu/libz.so.1
snappy:  false 
lz4:     true revision:10301
bzip2:   true /lib/x86_64-linux-gnu/libbz2.so.1
openssl: true /usr/lib/x86_64-linux-gnu/libcrypto.so
{code}

Ubuntu 14.04 lz4 -v output:
{code}
$ lz4 -h
*** LZ4 Compression CLI 64-bits r114, by Yann Collet (Apr 14 2014) ***
Usage :
      lz4 [arg] [input] [output]
...
{code}

The {{hadoop checknative}} shows library version "revision:10301", while Linux {{lz4 -h}}
shows cli version "r114". There is no way to match library version {{LZ4_VERSION_NUMBER in
lz.h}} and cli version {{LZ4_VERSION in lz4cli.c}} without the source code if it is 1-1 mapping.

> Lz4Compressor#getLibraryName returns the wrong version number
> -------------------------------------------------------------
>
>                 Key: HADOOP-12972
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12972
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: native
>    Affects Versions: 2.6.0
>            Reporter: John Zhuge
>            Assignee: Colin Patrick McCabe
>            Priority: Trivial
>             Fix For: 2.8.0
>
>         Attachments: HADOOP-12972.001.patch
>
>
> HADOOP-11184 updated lz4 to "r123", but {{hadoop checknative -a}} still prints "revision:99".
> {code}
> $ hadoop checknative -a
> 16/03/29 11:42:40 INFO bzip2.Bzip2Factory: Successfully loaded & initialized native-bzip2
library system-native
> 16/03/29 11:42:40 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib
library
> Native library checking:
> hadoop:  true /opt/cloudera/parcels/CDH-5.8.0-1.cdh5.8.0.p0.1209/lib/hadoop/lib/native/libhadoop.so.1.0.0
> zlib:    true /lib64/libz.so.1
> snappy:  true /opt/cloudera/parcels/CDH-5.8.0-1.cdh5.8.0.p0.1209/lib/hadoop/lib/native/libsnappy.so.1
> lz4:     true revision:99
> bzip2:   true /lib64/libbz2.so.1
> openssl: true /usr/lib64/libcrypto.so
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message