hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matt Foley (Reopened) (JIRA)" <j...@apache.org>
Subject [jira] [Reopened] (HADOOP-8037) Binary tarball does not preserve platform info for native builds, and RPMs fail to provide needed symlinks for libhadoop.so
Date Thu, 09 Feb 2012 06:19:59 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Matt Foley reopened HADOOP-8037:
--------------------------------


Regrettably, I have to revert this patch.  I didn't notice it before, but the sizes of the
resulting rpm and bin-tarball files are greatly increased due to duplicated files.  We have
to try again:

{code}
pre-patch sizes:
-rw-r--r-- 1 hortonfo users 31975332 Jan 31 02:42 hadoop_1.0.1-1_amd64.deb
-rw-r--r-- 1 hortonfo users 32039471 Jan 31 02:40 hadoop-1.0.1-1.amd64.rpm
-rw-r--r-- 1 hortonfo users 35909710 Jan 31 02:35 hadoop_1.0.1-1_i386.deb
-rw-r--r-- 1 hortonfo users 35974659 Jan 31 02:34 hadoop-1.0.1-1.i386.rpm
-rw-r--r-- 1 hortonfo users 31965140 Jan 31 02:41 hadoop-1.0.1-bin.tar.gz
-rw-r--r-- 1 hortonfo users 60322619 Jan 31 02:39 hadoop-1.0.1.tar.gz

post-patch sizes:
-rw-r--r-- 1 hortonfo users  93729906 Feb  9 03:38 hadoop_1.0.1-1_amd64.deb
-rw-r--r-- 1 hortonfo users  40754076 Feb  9 03:36 hadoop-1.0.1-1.amd64.rpm
-rw-r--r-- 1 hortonfo users 101357042 Feb  9 03:29 hadoop_1.0.1-1_i386.deb
-rw-r--r-- 1 hortonfo users  48735998 Feb  9 03:27 hadoop-1.0.1-1.i386.rpm
-rw-r--r-- 1 hortonfo users  66467789 Feb  9 03:38 hadoop-1.0.1-bin.tar.gz
-rw-r--r-- 1 hortonfo users  60782862 Feb  9 03:34 hadoop-1.0.1.tar.gz

pre-patch file counts:
    445 hadoop-1.0.1-1.amd64.rpm
    445 hadoop-1.0.1-1.i386.rpm
    330 hadoop-1.0.1-bin.tar.gz
   6974 hadoop-1.0.1.tar.gz

post-patch file counts:
    789 hadoop-1.0.1-1.amd64.rpm
    792 hadoop-1.0.1-1.i386.rpm
    668 hadoop-1.0.1-bin.tar.gz
   6978 hadoop-1.0.1.tar.gz
{code}

                
> Binary tarball does not preserve platform info for native builds, and RPMs fail to provide
needed symlinks for libhadoop.so
> ---------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-8037
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8037
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 1.0.1
>            Reporter: Matt Foley
>            Assignee: Giridharan Kesavan
>            Priority: Blocker
>         Attachments: hadoop-8027-1.patch, hadoop-8037-1.patch, hadoop-8037.patch
>
>
> The source tarball uses "package" ant target, which includes both sets of native builds
(32 and 64 bit libraries), under subdirectories that are named for the supported platform,
so you can tell what they are.
> The binary tarball uses the "bin-package" ant target, which projects both sets of native
builds into a single directory, stripping out the platform names from the directory paths.
 Since the native built libraries have identical names, only one of each survives the process.
 Afterward, there is no way to know whether they are intended for 32 or 64 bit environments.
> It seems to be done this way as a step toward building the rpm and deb artifacts.  But
the rpms and debs are self-identifying as to the platform they were built for, and contain
only one set of libs each, while the binary tarball isn't.  The binary tarball should have
the same platform-specific subdirectories that the full tarball does; but this means that
the rpm and deb builds have to be more careful about include/exclude specs for what goes into
those artifacts.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message