spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Patrick Wendell (JIRA)" <>
Subject [jira] [Created] (SPARK-2526) Simplify
Date Wed, 16 Jul 2014 17:12:06 GMT
Patrick Wendell created SPARK-2526:

             Summary: Simplify
                 Key: SPARK-2526
             Project: Spark
          Issue Type: Bug
          Components: Build
            Reporter: Patrick Wendell
            Assignee: Patrick Wendell

There is a some complexity around selecting profiles. This is both annoying
to maintain and also limits the number of ways that packagers can use this. For instance,
it's not possible to build with separate HDFS and YARN versions, and supporting this with
our current flags would get pretty complicated. We should just allow the user to pass a list
of profiles directly to - the Maven build itself is already parameterized
to support this. We also now have good docs explaining the use of profiles in the Maven build.

All of this logic was more necessary when we used SBT for the package build, but we haven't
done that for several versions.

This message was sent by Atlassian JIRA

View raw message