spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Patrick Wendell (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-2526) Simplify make-distribution.sh to just pass through Maven options
Date Thu, 17 Jul 2014 08:04:05 GMT

     [ https://issues.apache.org/jira/browse/SPARK-2526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Patrick Wendell resolved SPARK-2526.
------------------------------------

       Resolution: Fixed
    Fix Version/s: 1.1.0

Issue resolved by pull request 1445
[https://github.com/apache/spark/pull/1445]

> Simplify make-distribution.sh to just pass through Maven options
> ----------------------------------------------------------------
>
>                 Key: SPARK-2526
>                 URL: https://issues.apache.org/jira/browse/SPARK-2526
>             Project: Spark
>          Issue Type: Bug
>          Components: Build
>            Reporter: Patrick Wendell
>            Assignee: Patrick Wendell
>             Fix For: 1.1.0
>
>
> There is a some complexity make-distribution.sh around selecting profiles. This is both
annoying to maintain and also limits the number of ways that packagers can use this. For instance,
it's not possible to build with separate HDFS and YARN versions, and supporting this with
our current flags would get pretty complicated. We should just allow the user to pass a list
of profiles directly to make-distribution.sh - the Maven build itself is already parameterized
to support this. We also now have good docs explaining the use of profiles in the Maven build.
> All of this logic was more necessary when we used SBT for the package build, but we haven't
done that for several versions.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message