hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Nauroth (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-9008) Building hadoop tarball fails on Windows
Date Thu, 08 Nov 2012 00:14:12 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chris Nauroth updated HADOOP-9008:
----------------------------------

    Attachment: HADOOP-9008-branch-trunk-win.patch

The attached patch ports the sh scripting in the distribution build to Python.  It wasn't
possible to use only Maven plugins (like maven-antrun-plugin with a <tar> task), because
they mishandled permissions and symlinks in the built tarballs.

I tested all of the following build variations:

Windows: mvn -Pnative-win -Pdist -Dtar -DskipTests clean package
Mac: mvn -Pdist -Dtar -DskipTests clean package
Ubuntu: mvn -Pnative -Pdist -Dtar -DskipTests clean package
Ubuntu: mvn -Pnative -Pdist -Dtar -Drequire.snappy -Dbundle.snappy -Dsnappy.lib=/usr/local/lib
-DskipTests clean package

This works on Windows.  Additionally, on Mac and Ubuntu, I compared the built tarballs from
before and after my changes.  I confirmed that the resulting tarballs have exactly the same
contents, including permissions and symlinks.

                
> Building hadoop tarball fails on Windows
> ----------------------------------------
>
>                 Key: HADOOP-9008
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9008
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: trunk-win
>            Reporter: Ivan Mitic
>            Assignee: Chris Nauroth
>         Attachments: HADOOP-9008-branch-trunk-win.patch
>
>
> Trying to build Hadoop trunk tarball via {{mvn package -Pdist -DskipTests -Dtar}} fails
on Windows.
> Build system generates sh scripts that execute build tasks what does not work on Windows
without Cygwin. It might make sense to apply the same pattern as in HADOOP-8924, and use python
instead of sh.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message