hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Nauroth (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-4780) MapReduce distribution build fails on Windows
Date Thu, 08 Nov 2012 00:14:12 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-4780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Chris Nauroth updated MAPREDUCE-4780:

    Attachment: MAPREDUCE-4780-branch-trunk-win.patch

The attached patch ports the sh scripting in the distribution build to Python.  It wasn't
possible to use only Maven plugins (like maven-antrun-plugin with a <tar> task), because
they mishandled permissions and symlinks in the built tarballs.

I tested all of the following build variations:

Windows: mvn -Pnative-win -Pdist -Dtar -DskipTests clean package
Mac: mvn -Pdist -Dtar -DskipTests clean package
Ubuntu: mvn -Pnative -Pdist -Dtar -DskipTests clean package
Ubuntu: mvn -Pnative -Pdist -Dtar -Drequire.snappy -Dbundle.snappy -Dsnappy.lib=/usr/local/lib
-DskipTests clean package

This works on Windows.  Additionally, on Mac and Ubuntu, I compared the built tarballs from
before and after my changes.  I confirmed that the resulting tarballs have exactly the same
contents, including permissions and symlinks.

> MapReduce distribution build fails on Windows
> ---------------------------------------------
>                 Key: MAPREDUCE-4780
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4780
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: trunk-win
>            Reporter: Chris Nauroth
>            Assignee: Chris Nauroth
>         Attachments: MAPREDUCE-4780-branch-trunk-win.patch
> Distribution build relies on sh scripts that do not work on Windows.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message