spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Reynold Xin <r...@databricks.com>
Subject Re: Building and Running Spark on OS X
Date Tue, 21 Oct 2014 00:00:21 GMT
I usually use SBT on Mac and that one doesn't require any setup ...


On Mon, Oct 20, 2014 at 4:43 PM, Nicholas Chammas <
nicholas.chammas@gmail.com> wrote:

> If one were to put together a short but comprehensive guide to setting up
> Spark to run locally on OS X, would it look like this?
>
> # Install Maven. On OS X, we suggest using Homebrew.
> brew install maven
> # Set some important Java and Maven environment variables.export
> JAVA_HOME=$(/usr/libexec/java_home)export MAVEN_OPTS="-Xmx512m
> -XX:MaxPermSize=128m"
> # Go to where you downloaded the Spark source.cd ./spark
> # Build, configure slaves, and startup Spark.
> mvn -DskipTests clean packageecho "localhost" > ./conf/slaves
> ./sbin/start-all.sh
> # Rock 'n' Roll.
> ./bin/pyspark
> # Cleanup when you're done.
> ./sbin/stop-all.sh
>
> Nick
> ‚Äč
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message