hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ilya Maykov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-10359) Native bzip2 compression support is broken on non-Linux systems
Date Sat, 22 Feb 2014 02:27:19 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-10359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13909167#comment-13909167

Ilya Maykov commented on HADOOP-10359:

Note: I believe that native support is broken on non-linux systems because the header file
unconditionally does

#define HADOOP_BZIP2_LIBRARY "libbz2.so.1"

which I think is only correct for Linux according to some comments found in CMakeLists.txt
(Windows should have a ".dll", FreeBSD a ."so" without the version, and Mac OS X a ".version.dylib").
However I've only verified that it's broken on Mac OS X.

> Native bzip2 compression support is broken on non-Linux systems
> ---------------------------------------------------------------
>                 Key: HADOOP-10359
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10359
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: native
>    Affects Versions: 2.2.0
>         Environment: Mac OS X 10.8.5
> Oracle JDK 1.7.0_51
> Hadoop 2.2.0-CDH5.0.0-beta-2
>            Reporter: Ilya Maykov
>            Priority: Minor
>         Attachments: HADOOP-10359-native-bzip2-for-os-x.patch
> While testing the patch for HADOOP-9648, I noticed that the bzip2 native compressor/decompressor
support wasn't working properly. I dug around a bit and got native bzip2 support to work on
my macbook. Will attach a patch in a bit. (This probably needs to be tested on FreeBSD / Windows
/ Linux, but I don't have the time to set up the necessary VMs to do it. I assume the build
bot will test Linux).

This message was sent by Atlassian JIRA

View raw message