incubator-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matei Zaharia <matei.zaha...@gmail.com>
Subject Re: [VOTE] Release Apache Spark 0.8.0-incubating (rc4)
Date Sat, 14 Dec 2013 19:13:30 GMT
Hi Marvin,

These are not actually files compiled from our source code, but third-party dependencies that
are not published to Maven. SBT is a Scala-based build tool where you need that JAR to run.
Where exactly is the policy on including these kinds of JARs?

The reason we went with them is because we saw other projects do it. For example, Kafka, which
also builds using SBT, ships with sbt.jar.

Matei

On Dec 14, 2013, at 10:58 AM, Marvin Humphrey <marvin@rectangular.com> wrote:

> On Sat, Dec 14, 2013 at 10:37 AM, Henry Saputra <henry.saputra@gmail.com> wrote:
>> When you said "However they both contain binaries, which is not good."
>> were you talking about the "spark-0.8.1-incubating-bin-* files ?
> 
> There seem to be compiled files in the source archive.
> 
> marvin@knut:~/spark $ tar -zxf spark-0.8.1-incubating.tgz
> marvin@knut:~/spark $ cd spark-0.8.1-incubating
> marvin@knut:~/spark/spark-0.8.1-incubating $ find . -print | grep ".jar$"
> ./assembly/lib/net/sf/py4j/py4j/0.7/py4j-0.7.jar
> ./core/src/test/resources/uncommons-maths-1.2.2.jar
> ./repl/lib/scala-jline.jar
> ./sbt/sbt-launch-0.11.3-2.jar
> ./streaming/lib/org/apache/kafka/kafka/0.7.2-spark/kafka-0.7.2-spark.jar
> marvin@knut:~/spark/spark-0.8.1-incubating $
> 
> One option for addressing that issue would be to move all compiled
> dependencies to an accompanying "-deps" archive.
> 
> Marvin Humphrey
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org


Mime
View raw message