spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bersprockets <>
Subject [GitHub] spark pull request #21628: [SPARK-23776][DOC] Update instructions for runnin...
Date Mon, 25 Jun 2018 02:39:29 GMT
Github user bersprockets commented on a diff in the pull request:
    --- Diff: docs/ ---
    @@ -215,19 +215,23 @@ If you are building Spark for use in a Python environment and you
wish to pip in
     Alternatively, you can also run make-distribution with the --pip option.
    -## PySpark Tests with Maven
    +## PySpark Tests with Maven or SBT
     If you are building PySpark and wish to run the PySpark tests you will need to build
Spark with Hive support.
         ./build/mvn -DskipTests clean package -Phive
    +If you are building PySpark with SBT and wish to run the PySpark tests, you will need
to build Spark with Hive support and also build the test components:
    +    ./build/sbt -Phive clean package
    --- End diff --
    I noticed that the pyspark tests were recently changed so that -Phive is no longer strictly
necessary to run pyspark tests, but I decided not to address that in this update.


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message