spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Henry Saputra <henry.sapu...@gmail.com>
Subject Re: git commit: Hard code scala version in pom files.
Date Mon, 16 Sep 2013 17:58:56 GMT
Agree with this. POM file reflects the state of the project at a
particular moment so it is metadata of the project but should be
treated as part of source code.


- Henry

On Sun, Sep 15, 2013 at 9:30 PM, Konstantin Boudnik <cos@apache.org> wrote:
> Guys,
>
> actually, POM files are artifacts metadata. Hence, IMO it should be treated as
> a part of the source code. Simply because POM file should be a reflection on
> what is going into the source code at the moment.
>
> Makefiles are fun ;), but it would be an interesting experiment to say the
> least.
>
> Cos
>
> On Sun, Sep 15, 2013 at 07:19PM, Jey Kottalam wrote:
>> I'm overall in favor of treating POM files as some kind of disgusting
>> object code that our build process just has to generate in some way,
>> instead of treating POM files as source code itself. An analogue would
>> be that we don't write machine code by hand, but instead use a
>> high-level language that is comparatively sane combined with a
>> compiler that accounts for all the bizarre quirks and details specific
>> to getting a working x86/ELF executable.
>>
>> Maybe we should write our POM files in a macro language, and have a
>> Makefile that configures and generates the actual POM files seen by
>> Maven? This would allow us to both be in full compliance with Maven's
>> demands yet wrest back control of the build system.
>>
>> However: for the 0.8.0 release, I support just hardcoding the scala
>> version in the POM files that we ship to the Maven repositories, and
>> revisiting this later. I think Patrick is right that Maven is warning
>> about these issues for some legitimate reason that may only be
>> encountered by downstream users, so we should proactively address the
>> warnings unless we're certain they can be ignored. We could revert
>> commit a1e7e519 on master as soon as the final 0.8.0 build is shipped.
>>
>> -Jey
>>
>> On Sun, Sep 15, 2013 at 6:46 PM, Mark Hamstra <mark@clearstorydata.com> wrote:
>> > Ah sorry, I've gotten so used to using ClearStory's poms (where we make
>> > quite a lot of use of such parameterization) that I lost track of exactly
>> > when Spark's maven build was changed to work in a similar way.
>> >
>> > This all revolves around a basic difference of opinion as to whether the
>> > thing that specifies how a project is built should be a fixed, static
>> > document or is more of a program itself or a parameterized function that
>> > drives the build and results in an artifact.  SBT is of the latter opinion,
>> > while Maven (at least with Maven 3) is going the other way.  That means
>> > that building idiomatic Scala artifacts (which expect things like
>> > cross-versioning support and artifactIds that include the Scala binary
>> > version that was used to create them) is somewhat at odds with the Maven
>> > philosophy.  Hard-coding artifactIds, versions, and whatever else Maven now
>> > requires to guarantee that a pom file be a fixed, repeatable build
>> > description works okay for a single build of an artifact; and a user of
>> > just that built artifact won't have to change behavior if the pom is no
>> > longer parameterized.  However, users who are not just interested in using
>> > pre-built artifacts but also in modifying, adding to or reusing the code do
>> > have to change their behavior if parameterized Maven builds disappear (yes,
>> > you have pointed out the state of affairs with the 0.6 and 0.7 releases;
>> > I'll point out that some of those making further use of the code have been
>> > using the current, not-yet-released poms for a good while.)
>> >
>> > Without some form of parameterized Maven builds, developers who now rely
>> > upon such parameterized builds will have to choose to fork the Apache poms
>> > and maintain their own parameterized build, or to repeatedly and manually
>> > edit static Apache pom files in order to change artifactIds and dependency
>> > versions (which is a frequent need when integrating Spark into a much
>> > larger and more complicated technology stack), or to switch over to using
>> > SBT in order to get parameterized builds (which, of course, would
>> > necessitate a lot of other changes, not all of them welcome.)  Archetypes
>> > or something similar seems like a way to satisfy Maven's new requirement
>> > for static build configurations while at the same time providing a
>> > parameterized way to generate that configuration or a modified version of
>> > it -- solving the problem by adding a layer of abstraction.
>> >
>> >
>> > On Sun, Sep 15, 2013 at 6:12 PM, Patrick Wendell <pwendell@gmail.com>
wrote:
>> >
>> >> Hey Mark,
>> >>
>> >> Could you describe a user whose behavior is changed by this, and how
>> >> it is changed? This commit actually brings 0.8 in line with the 0.7
>> >> and 0.6 branches, where the scala version is hard coded in the
>> >> released artifacts:
>> >>
>> >>
>> >> http://repo1.maven.org/maven2/org/spark-project/spark-streaming_2.9.3/0.7.3/spark-streaming_2.9.3-0.7.3.pom
>> >>
>> >> That seems to me to minimize the changes in user behavior as much as
>> >> possible. It would be bad if during the 0.8 release the format of our
>> >> released artifacts changed in a way that caused things to break for
>> >> users. One example of something that could break is an IDE or some
>> >> other tool that consumes these builds downstream and isn't aware of
>> >> scala versioning.
>> >>
>> >> We can have a more intricate solution on the master branch if you'd
>> >> like. This is just a fix to bring the 0.8 branch into line with our
>> >> existing releases (and since 0.8 only supports scala 2.9.3 anyways,
>> >> I'm still not sure how this could affect any users adversely).
>> >>
>> >> - Patrick
>> >>
>> >> On Sun, Sep 15, 2013 at 5:41 PM, Mark Hamstra <mark@clearstorydata.com>
>> >> wrote:
>> >> > Whoa there, cowboy!
>> >> >
>> >> > It's just a warning, and removing parameterized artifactIds (or versions)
>> >> > is a significant change in functionality that necessitates changes
in
>> >> user
>> >> > behavior.  At a minimum, this needs to be discussed before we go this
>> >> > route.  If we really want to get rid of the warnings right away, then
we
>> >> > should try not to lose functionality and to require as little user
>> >> behavior
>> >> > change as possible.  The Maven Archetype
>> >> > Plugin<
>> >> http://maven.apache.org/guides/introduction/introduction-to-archetypes.html
>> >> >
>> >> > may
>> >> > be the right way to do that.
>> >> >
>> >> > Do we have some set-in-stone requirement to quash all maven warnings
>> >> before
>> >> > release?  If not, I'd recommend leaving the parameterized pom files
in
>> >> > place for now and change over to something like archetypes for 0.8.1
--
>> >> the
>> >> > change to use archetypes is bigger than I am comfortable with making
>> >> > hastily as we try to get 0.8.0 released.
>> >> >
>> >> >
>> >> >
>> >> > On Sun, Sep 15, 2013 at 4:58 PM, <pwendell@apache.org> wrote:
>> >> >
>> >> >> Updated Branches:
>> >> >>   refs/heads/branch-0.8 7f71f49ad -> a1e7e5196
>> >> >>
>> >> >>
>> >> >> Hard code scala version in pom files.
>> >> >>
>> >> >> Unfortunately, having an expression inside of an artifactId causes
>> >> >> warnings from Maven.
>> >> >>
>> >> >>
>> >> >> Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
>> >> >> Commit:
>> >> >> http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/a1e7e519
>> >> >> Tree:
>> >> http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/a1e7e519
>> >> >> Diff:
>> >> http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/a1e7e519
>> >> >>
>> >> >> Branch: refs/heads/branch-0.8
>> >> >> Commit: a1e7e519653beae47cafccbb9e335bc74986c0dc
>> >> >> Parents: 7f71f49
>> >> >> Author: Patrick Wendell <pwendell@gmail.com>
>> >> >> Authored: Sun Sep 15 16:56:30 2013 -0700
>> >> >> Committer: Patrick Wendell <pwendell@gmail.com>
>> >> >> Committed: Sun Sep 15 16:56:30 2013 -0700
>> >> >>
>> >> >> ----------------------------------------------------------------------
>> >> >>  assembly/pom.xml  | 14 +++++++-------
>> >> >>  bagel/pom.xml     |  8 ++++----
>> >> >>  core/pom.xml      |  8 ++++----
>> >> >>  examples/pom.xml  | 14 +++++++-------
>> >> >>  mllib/pom.xml     |  8 ++++----
>> >> >>  pom.xml           |  6 +++---
>> >> >>  repl-bin/pom.xml  |  8 ++++----
>> >> >>  repl/pom.xml      | 12 ++++++------
>> >> >>  streaming/pom.xml |  8 ++++----
>> >> >>  tools/pom.xml     |  8 ++++----
>> >> >>  yarn/pom.xml      |  4 ++--
>> >> >>  11 files changed, 49 insertions(+), 49 deletions(-)
>> >> >> ----------------------------------------------------------------------
>> >> >>
>> >> >>
>> >> >>
>> >> >>
>> >> http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/a1e7e519/assembly/pom.xml
>> >> >> ----------------------------------------------------------------------
>> >> >> diff --git a/assembly/pom.xml b/assembly/pom.xml
>> >> >> index 778f7b1..397f79d 100644
>> >> >> --- a/assembly/pom.xml
>> >> >> +++ b/assembly/pom.xml
>> >> >> @@ -26,7 +26,7 @@
>> >> >>    </parent>
>> >> >>
>> >> >>    <groupId>org.apache.spark</groupId>
>> >> >> -  <artifactId>spark-assembly_${scala.version}</artifactId>
>> >> >> +  <artifactId>spark-assembly_2.9.3</artifactId>
>> >> >>    <name>Spark Project Assembly</name>
>> >> >>    <url>http://spark.incubator.apache.org/</url>
>> >> >>
>> >> >> @@ -41,27 +41,27 @@
>> >> >>    <dependencies>
>> >> >>      <dependency>
>> >> >>        <groupId>org.apache.spark</groupId>
>> >> >> -      <artifactId>spark-core_${scala.version}</artifactId>
>> >> >> +      <artifactId>spark-core_2.9.3</artifactId>
>> >> >>        <version>${project.version}</version>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.apache.spark</groupId>
>> >> >> -      <artifactId>spark-bagel_${scala.version}</artifactId>
>> >> >> +      <artifactId>spark-bagel_2.9.3</artifactId>
>> >> >>        <version>${project.version}</version>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.apache.spark</groupId>
>> >> >> -      <artifactId>spark-mllib_${scala.version}</artifactId>
>> >> >> +      <artifactId>spark-mllib_2.9.3</artifactId>
>> >> >>        <version>${project.version}</version>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.apache.spark</groupId>
>> >> >> -      <artifactId>spark-repl_${scala.version}</artifactId>
>> >> >> +      <artifactId>spark-repl_2.9.3</artifactId>
>> >> >>        <version>${project.version}</version>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.apache.spark</groupId>
>> >> >> -      <artifactId>spark-streaming_${scala.version}</artifactId>
>> >> >> +      <artifactId>spark-streaming_2.9.3</artifactId>
>> >> >>        <version>${project.version}</version>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >> @@ -128,7 +128,7 @@
>> >> >>        <dependencies>
>> >> >>          <dependency>
>> >> >>            <groupId>org.apache.spark</groupId>
>> >> >> -          <artifactId>spark-yarn_${scala.version}</artifactId>
>> >> >> +          <artifactId>spark-yarn_2.9.3</artifactId>
>> >> >>            <version>${project.version}</version>
>> >> >>          </dependency>
>> >> >>        </dependencies>
>> >> >>
>> >> >>
>> >> >>
>> >> http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/a1e7e519/bagel/pom.xml
>> >> >> ----------------------------------------------------------------------
>> >> >> diff --git a/bagel/pom.xml b/bagel/pom.xml
>> >> >> index 1248b04..9839aa5 100644
>> >> >> --- a/bagel/pom.xml
>> >> >> +++ b/bagel/pom.xml
>> >> >> @@ -26,7 +26,7 @@
>> >> >>    </parent>
>> >> >>
>> >> >>    <groupId>org.apache.spark</groupId>
>> >> >> -  <artifactId>spark-bagel_${scala.version}</artifactId>
>> >> >> +  <artifactId>spark-bagel_2.9.3</artifactId>
>> >> >>    <packaging>jar</packaging>
>> >> >>    <name>Spark Project Bagel</name>
>> >> >>    <url>http://spark.incubator.apache.org/</url>
>> >> >> @@ -34,7 +34,7 @@
>> >> >>    <dependencies>
>> >> >>      <dependency>
>> >> >>        <groupId>org.apache.spark</groupId>
>> >> >> -      <artifactId>spark-core_${scala.version}</artifactId>
>> >> >> +      <artifactId>spark-core_2.9.3</artifactId>
>> >> >>        <version>${project.version}</version>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >> @@ -43,12 +43,12 @@
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.scalatest</groupId>
>> >> >> -      <artifactId>scalatest_${scala.version}</artifactId>
>> >> >> +      <artifactId>scalatest_2.9.3</artifactId>
>> >> >>        <scope>test</scope>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.scalacheck</groupId>
>> >> >> -      <artifactId>scalacheck_${scala.version}</artifactId>
>> >> >> +      <artifactId>scalacheck_2.9.3</artifactId>
>> >> >>        <scope>test</scope>
>> >> >>      </dependency>
>> >> >>    </dependencies>
>> >> >>
>> >> >>
>> >> >>
>> >> http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/a1e7e519/core/pom.xml
>> >> >> ----------------------------------------------------------------------
>> >> >> diff --git a/core/pom.xml b/core/pom.xml
>> >> >> index 53756e9..b20ace9 100644
>> >> >> --- a/core/pom.xml
>> >> >> +++ b/core/pom.xml
>> >> >> @@ -26,7 +26,7 @@
>> >> >>    </parent>
>> >> >>
>> >> >>    <groupId>org.apache.spark</groupId>
>> >> >> -  <artifactId>spark-core_${scala.version}</artifactId>
>> >> >> +  <artifactId>spark-core_2.9.3</artifactId>
>> >> >>    <packaging>jar</packaging>
>> >> >>    <name>Spark Project Core</name>
>> >> >>    <url>http://spark.incubator.apache.org/</url>
>> >> >> @@ -82,7 +82,7 @@
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>com.twitter</groupId>
>> >> >> -      <artifactId>chill_${scala.version}</artifactId>
>> >> >> +      <artifactId>chill_2.9.3</artifactId>
>> >> >>        <version>0.3.1</version>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >> @@ -161,12 +161,12 @@
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.scalatest</groupId>
>> >> >> -      <artifactId>scalatest_${scala.version}</artifactId>
>> >> >> +      <artifactId>scalatest_2.9.3</artifactId>
>> >> >>        <scope>test</scope>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.scalacheck</groupId>
>> >> >> -      <artifactId>scalacheck_${scala.version}</artifactId>
>> >> >> +      <artifactId>scalacheck_2.9.3</artifactId>
>> >> >>        <scope>test</scope>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>
>> >> >>
>> >> >>
>> >> http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/a1e7e519/examples/pom.xml
>> >> >> ----------------------------------------------------------------------
>> >> >> diff --git a/examples/pom.xml b/examples/pom.xml
>> >> >> index aaa2f04..99ff67a 100644
>> >> >> --- a/examples/pom.xml
>> >> >> +++ b/examples/pom.xml
>> >> >> @@ -26,7 +26,7 @@
>> >> >>    </parent>
>> >> >>
>> >> >>    <groupId>org.apache.spark</groupId>
>> >> >> -  <artifactId>spark-examples_${scala.version}</artifactId>
>> >> >> +  <artifactId>spark-examples_2.9.3</artifactId>
>> >> >>    <packaging>jar</packaging>
>> >> >>    <name>Spark Project Examples</name>
>> >> >>    <url>http://spark.incubator.apache.org/</url>
>> >> >> @@ -34,25 +34,25 @@
>> >> >>    <dependencies>
>> >> >>      <dependency>
>> >> >>        <groupId>org.apache.spark</groupId>
>> >> >> -      <artifactId>spark-core_${scala.version}</artifactId>
>> >> >> +      <artifactId>spark-core_2.9.3</artifactId>
>> >> >>        <version>${project.version}</version>
>> >> >>        <scope>provided</scope>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.apache.spark</groupId>
>> >> >> -      <artifactId>spark-streaming_${scala.version}</artifactId>
>> >> >> +      <artifactId>spark-streaming_2.9.3</artifactId>
>> >> >>        <version>${project.version}</version>
>> >> >>        <scope>provided</scope>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.apache.spark</groupId>
>> >> >> -      <artifactId>spark-mllib_${scala.version}</artifactId>
>> >> >> +      <artifactId>spark-mllib_2.9.3</artifactId>
>> >> >>        <version>${project.version}</version>
>> >> >>        <scope>provided</scope>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.apache.spark</groupId>
>> >> >> -      <artifactId>spark-bagel_${scala.version}</artifactId>
>> >> >> +      <artifactId>spark-bagel_2.9.3</artifactId>
>> >> >>        <version>${project.version}</version>
>> >> >>        <scope>provided</scope>
>> >> >>      </dependency>
>> >> >> @@ -82,12 +82,12 @@
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.scalatest</groupId>
>> >> >> -      <artifactId>scalatest_${scala.version}</artifactId>
>> >> >> +      <artifactId>scalatest_2.9.3</artifactId>
>> >> >>        <scope>test</scope>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.scalacheck</groupId>
>> >> >> -      <artifactId>scalacheck_${scala.version}</artifactId>
>> >> >> +      <artifactId>scalacheck_2.9.3</artifactId>
>> >> >>        <scope>test</scope>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>
>> >> >>
>> >> >>
>> >> http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/a1e7e519/mllib/pom.xml
>> >> >> ----------------------------------------------------------------------
>> >> >> diff --git a/mllib/pom.xml b/mllib/pom.xml
>> >> >> index ceddb78..11c0334 100644
>> >> >> --- a/mllib/pom.xml
>> >> >> +++ b/mllib/pom.xml
>> >> >> @@ -26,7 +26,7 @@
>> >> >>    </parent>
>> >> >>
>> >> >>    <groupId>org.apache.spark</groupId>
>> >> >> -  <artifactId>spark-mllib_${scala.version}</artifactId>
>> >> >> +  <artifactId>spark-mllib_2.9.3</artifactId>
>> >> >>    <packaging>jar</packaging>
>> >> >>    <name>Spark Project ML Library</name>
>> >> >>    <url>http://spark.incubator.apache.org/</url>
>> >> >> @@ -34,7 +34,7 @@
>> >> >>    <dependencies>
>> >> >>      <dependency>
>> >> >>        <groupId>org.apache.spark</groupId>
>> >> >> -      <artifactId>spark-core_${scala.version}</artifactId>
>> >> >> +      <artifactId>spark-core_2.9.3</artifactId>
>> >> >>        <version>${project.version}</version>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >> @@ -48,12 +48,12 @@
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.scalatest</groupId>
>> >> >> -      <artifactId>scalatest_${scala.version}</artifactId>
>> >> >> +      <artifactId>scalatest_2.9.3</artifactId>
>> >> >>        <scope>test</scope>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.scalacheck</groupId>
>> >> >> -      <artifactId>scalacheck_${scala.version}</artifactId>
>> >> >> +      <artifactId>scalacheck_2.9.3</artifactId>
>> >> >>        <scope>test</scope>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>
>> >> >>
>> >> >>
>> >> http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/a1e7e519/pom.xml
>> >> >> ----------------------------------------------------------------------
>> >> >> diff --git a/pom.xml b/pom.xml
>> >> >> index eb21dd9..0bd01f5 100644
>> >> >> --- a/pom.xml
>> >> >> +++ b/pom.xml
>> >> >> @@ -215,7 +215,7 @@
>> >> >>        </dependency>
>> >> >>        <dependency>
>> >> >>          <groupId>com.twitter</groupId>
>> >> >> -        <artifactId>chill_${scala.version}</artifactId>
>> >> >> +        <artifactId>chill_2.9.3</artifactId>
>> >> >>          <version>0.3.1</version>
>> >> >>        </dependency>
>> >> >>        <dependency>
>> >> >> @@ -323,7 +323,7 @@
>> >> >>
>> >> >>        <dependency>
>> >> >>          <groupId>org.scalatest</groupId>
>> >> >> -        <artifactId>scalatest_${scala.version}</artifactId>
>> >> >> +        <artifactId>scalatest_2.9.3</artifactId>
>> >> >>          <version>1.9.1</version>
>> >> >>          <scope>test</scope>
>> >> >>        </dependency>
>> >> >> @@ -335,7 +335,7 @@
>> >> >>        </dependency>
>> >> >>        <dependency>
>> >> >>          <groupId>org.scalacheck</groupId>
>> >> >> -        <artifactId>scalacheck_${scala.version}</artifactId>
>> >> >> +        <artifactId>scalacheck_2.9.3</artifactId>
>> >> >>          <version>1.10.0</version>
>> >> >>          <scope>test</scope>
>> >> >>        </dependency>
>> >> >>
>> >> >>
>> >> >>
>> >> http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/a1e7e519/repl-bin/pom.xml
>> >> >> ----------------------------------------------------------------------
>> >> >> diff --git a/repl-bin/pom.xml b/repl-bin/pom.xml
>> >> >> index bb77987..e2e1d8e 100644
>> >> >> --- a/repl-bin/pom.xml
>> >> >> +++ b/repl-bin/pom.xml
>> >> >> @@ -26,7 +26,7 @@
>> >> >>    </parent>
>> >> >>
>> >> >>    <groupId>org.apache.spark</groupId>
>> >> >> -  <artifactId>spark-repl-bin_${scala.version}</artifactId>
>> >> >> +  <artifactId>spark-repl-bin_2.9.3</artifactId>
>> >> >>    <packaging>pom</packaging>
>> >> >>    <name>Spark Project REPL binary packaging</name>
>> >> >>    <url>http://spark.incubator.apache.org/</url>
>> >> >> @@ -40,18 +40,18 @@
>> >> >>    <dependencies>
>> >> >>      <dependency>
>> >> >>        <groupId>org.apache.spark</groupId>
>> >> >> -      <artifactId>spark-core_${scala.version}</artifactId>
>> >> >> +      <artifactId>spark-core_2.9.3</artifactId>
>> >> >>        <version>${project.version}</version>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.apache.spark</groupId>
>> >> >> -      <artifactId>spark-bagel_${scala.version}</artifactId>
>> >> >> +      <artifactId>spark-bagel_2.9.3</artifactId>
>> >> >>        <version>${project.version}</version>
>> >> >>        <scope>runtime</scope>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.apache.spark</groupId>
>> >> >> -      <artifactId>spark-repl_${scala.version}</artifactId>
>> >> >> +      <artifactId>spark-repl_2.9.3</artifactId>
>> >> >>        <version>${project.version}</version>
>> >> >>        <scope>runtime</scope>
>> >> >>      </dependency>
>> >> >>
>> >> >>
>> >> >>
>> >> http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/a1e7e519/repl/pom.xml
>> >> >> ----------------------------------------------------------------------
>> >> >> diff --git a/repl/pom.xml b/repl/pom.xml
>> >> >> index 07d3d67..d2c71f6 100644
>> >> >> --- a/repl/pom.xml
>> >> >> +++ b/repl/pom.xml
>> >> >> @@ -26,7 +26,7 @@
>> >> >>    </parent>
>> >> >>
>> >> >>    <groupId>org.apache.spark</groupId>
>> >> >> -  <artifactId>spark-repl_${scala.version}</artifactId>
>> >> >> +  <artifactId>spark-repl_2.9.3</artifactId>
>> >> >>    <packaging>jar</packaging>
>> >> >>    <name>Spark Project REPL</name>
>> >> >>    <url>http://spark.incubator.apache.org/</url>
>> >> >> @@ -39,18 +39,18 @@
>> >> >>    <dependencies>
>> >> >>      <dependency>
>> >> >>        <groupId>org.apache.spark</groupId>
>> >> >> -      <artifactId>spark-core_${scala.version}</artifactId>
>> >> >> +      <artifactId>spark-core_2.9.3</artifactId>
>> >> >>        <version>${project.version}</version>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.apache.spark</groupId>
>> >> >> -      <artifactId>spark-bagel_${scala.version}</artifactId>
>> >> >> +      <artifactId>spark-bagel_2.9.3</artifactId>
>> >> >>        <version>${project.version}</version>
>> >> >>        <scope>runtime</scope>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.apache.spark</groupId>
>> >> >> -      <artifactId>spark-mllib_${scala.version}</artifactId>
>> >> >> +      <artifactId>spark-mllib_2.9.3</artifactId>
>> >> >>        <version>${project.version}</version>
>> >> >>        <scope>runtime</scope>
>> >> >>      </dependency>
>> >> >> @@ -76,12 +76,12 @@
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.scalatest</groupId>
>> >> >> -      <artifactId>scalatest_${scala.version}</artifactId>
>> >> >> +      <artifactId>scalatest_2.9.3</artifactId>
>> >> >>        <scope>test</scope>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.scalacheck</groupId>
>> >> >> -      <artifactId>scalacheck_${scala.version}</artifactId>
>> >> >> +      <artifactId>scalacheck_2.9.3</artifactId>
>> >> >>        <scope>test</scope>
>> >> >>      </dependency>
>> >> >>    </dependencies>
>> >> >>
>> >> >>
>> >> >>
>> >> http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/a1e7e519/streaming/pom.xml
>> >> >> ----------------------------------------------------------------------
>> >> >> diff --git a/streaming/pom.xml b/streaming/pom.xml
>> >> >> index ffe0c6e..f94e7e0 100644
>> >> >> --- a/streaming/pom.xml
>> >> >> +++ b/streaming/pom.xml
>> >> >> @@ -26,7 +26,7 @@
>> >> >>    </parent>
>> >> >>
>> >> >>    <groupId>org.apache.spark</groupId>
>> >> >> -  <artifactId>spark-streaming_${scala.version}</artifactId>
>> >> >> +  <artifactId>spark-streaming_2.9.3</artifactId>
>> >> >>    <packaging>jar</packaging>
>> >> >>    <name>Spark Project Streaming</name>
>> >> >>    <url>http://spark.incubator.apache.org/</url>
>> >> >> @@ -42,7 +42,7 @@
>> >> >>    <dependencies>
>> >> >>      <dependency>
>> >> >>        <groupId>org.apache.spark</groupId>
>> >> >> -      <artifactId>spark-core_${scala.version}</artifactId>
>> >> >> +      <artifactId>spark-core_2.9.3</artifactId>
>> >> >>        <version>${project.version}</version>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >> @@ -91,12 +91,12 @@
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.scalatest</groupId>
>> >> >> -      <artifactId>scalatest_${scala.version}</artifactId>
>> >> >> +      <artifactId>scalatest_2.9.3</artifactId>
>> >> >>        <scope>test</scope>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.scalacheck</groupId>
>> >> >> -      <artifactId>scalacheck_${scala.version}</artifactId>
>> >> >> +      <artifactId>scalacheck_2.9.3</artifactId>
>> >> >>        <scope>test</scope>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>
>> >> >>
>> >> >>
>> >> http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/a1e7e519/tools/pom.xml
>> >> >> ----------------------------------------------------------------------
>> >> >> diff --git a/tools/pom.xml b/tools/pom.xml
>> >> >> index e5080b3..40288da 100644
>> >> >> --- a/tools/pom.xml
>> >> >> +++ b/tools/pom.xml
>> >> >> @@ -25,7 +25,7 @@
>> >> >>    </parent>
>> >> >>
>> >> >>    <groupId>org.apache.spark</groupId>
>> >> >> -  <artifactId>spark-tools_${scala.version}</artifactId>
>> >> >> +  <artifactId>spark-tools_2.9.3</artifactId>
>> >> >>    <packaging>jar</packaging>
>> >> >>    <name>Spark Project Tools</name>
>> >> >>    <url>http://spark.incubator.apache.org/</url>
>> >> >> @@ -33,17 +33,17 @@
>> >> >>    <dependencies>
>> >> >>      <dependency>
>> >> >>        <groupId>org.apache.spark</groupId>
>> >> >> -      <artifactId>spark-core_${scala.version}</artifactId>
>> >> >> +      <artifactId>spark-core_2.9.3</artifactId>
>> >> >>        <version>${project.version}</version>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.apache.spark</groupId>
>> >> >> -      <artifactId>spark-streaming_${scala.version}</artifactId>
>> >> >> +      <artifactId>spark-streaming_2.9.3</artifactId>
>> >> >>        <version>${project.version}</version>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>        <groupId>org.scalatest</groupId>
>> >> >> -      <artifactId>scalatest_${scala.version}</artifactId>
>> >> >> +      <artifactId>scalatest_2.9.3</artifactId>
>> >> >>        <scope>test</scope>
>> >> >>      </dependency>
>> >> >>    </dependencies>
>> >> >>
>> >> >>
>> >> >>
>> >> http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/a1e7e519/yarn/pom.xml
>> >> >> ----------------------------------------------------------------------
>> >> >> diff --git a/yarn/pom.xml b/yarn/pom.xml
>> >> >> index 94d3025..b1674d2 100644
>> >> >> --- a/yarn/pom.xml
>> >> >> +++ b/yarn/pom.xml
>> >> >> @@ -25,7 +25,7 @@
>> >> >>    </parent>
>> >> >>
>> >> >>    <groupId>org.apache.spark</groupId>
>> >> >> -  <artifactId>spark-yarn_${scala.version}</artifactId>
>> >> >> +  <artifactId>spark-yarn_2.9.3</artifactId>
>> >> >>    <packaging>jar</packaging>
>> >> >>    <name>Spark Project YARN Support</name>
>> >> >>    <url>http://spark.incubator.apache.org/</url>
>> >> >> @@ -33,7 +33,7 @@
>> >> >>    <dependencies>
>> >> >>      <dependency>
>> >> >>        <groupId>org.apache.spark</groupId>
>> >> >> -      <artifactId>spark-core_${scala.version}</artifactId>
>> >> >> +      <artifactId>spark-core_2.9.3</artifactId>
>> >> >>        <version>${project.version}</version>
>> >> >>      </dependency>
>> >> >>      <dependency>
>> >> >>
>> >> >>
>> >>

Mime
View raw message