spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Patrick Wendell (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-2526) Simplify make-distribution.sh
Date Wed, 16 Jul 2014 17:12:06 GMT
Patrick Wendell created SPARK-2526:
--------------------------------------

             Summary: Simplify make-distribution.sh
                 Key: SPARK-2526
                 URL: https://issues.apache.org/jira/browse/SPARK-2526
             Project: Spark
          Issue Type: Bug
          Components: Build
            Reporter: Patrick Wendell
            Assignee: Patrick Wendell


There is a some complexity make-distribution.sh around selecting profiles. This is both annoying
to maintain and also limits the number of ways that packagers can use this. For instance,
it's not possible to build with separate HDFS and YARN versions, and supporting this with
our current flags would get pretty complicated. We should just allow the user to pass a list
of profiles directly to make-distribution.sh - the Maven build itself is already parameterized
to support this. We also now have good docs explaining the use of profiles in the Maven build.

All of this logic was more necessary when we used SBT for the package build, but we haven't
done that for several versions.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message