zeppelin-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From m...@apache.org
Subject incubator-zeppelin git commit: expanded build instructions to describe pyspark, and maven + node.js requirements
Date Mon, 09 Nov 2015 12:23:53 GMT
Repository: incubator-zeppelin
Updated Branches:
  refs/heads/branch-0.5.5 0af2ea047 -> 197e339d2


expanded build instructions to describe pyspark, and maven + node.js requirements

Author: Jeff Steinmetz <jeffrey.steinmetz@gmail.com>

Closes #405 from jeffsteinmetz/branch-0.5.5 and squashes the following commits:

d59230d [Jeff Steinmetz] use maven 3.3 link in setup example.  old links outdated
68cb04b [Jeff Steinmetz] maven install via apt-get clobbers the openjdk-7 install, and installs
java6.  It also installs an older maven version.  Update ubuntu install example.
e457745 [Jeff Steinmetz] expanded build instructions to include pyspark, and clarified maven
and node.js requirements
27e7930 [Jeff Steinmetz] expanded build instructions to include pyspark, and clarified maven
and node.js requirements
1015f86 [Jeff Steinmetz] expanded build instructions to include pyspark, and clarified maven
and node.js requirements
9617c01 [Jeff Steinmetz] expanded build instructions to include pyspark, and clarified maven
and node.js requirements


Project: http://git-wip-us.apache.org/repos/asf/incubator-zeppelin/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-zeppelin/commit/197e339d
Tree: http://git-wip-us.apache.org/repos/asf/incubator-zeppelin/tree/197e339d
Diff: http://git-wip-us.apache.org/repos/asf/incubator-zeppelin/diff/197e339d

Branch: refs/heads/branch-0.5.5
Commit: 197e339d204f77a72a67f8f6033f103d95db338f
Parents: 0af2ea0
Author: Jeff Steinmetz <jeffrey.steinmetz@gmail.com>
Authored: Sat Nov 7 21:24:53 2015 -0800
Committer: Lee moon soo <moon@apache.org>
Committed: Mon Nov 9 21:23:58 2015 +0900

----------------------------------------------------------------------
 README.md | 55 +++++++++++++++++++++++++++++++++++++++++++++++++------
 1 file changed, 49 insertions(+), 6 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/incubator-zeppelin/blob/197e339d/README.md
----------------------------------------------------------------------
diff --git a/README.md b/README.md
index b2beaa4..ff58299 100644
--- a/README.md
+++ b/README.md
@@ -27,75 +27,112 @@ To know more about Zeppelin, visit our web site [http://zeppelin.incubator.apach
 ### Before Build
 If you don't have requirements prepared, install it. 
 (The installation method may vary according to your environment, example is for Ubuntu.)
+
 ```
 sudo apt-get update
-sudo apt-get install openjdk-7-jdk
 sudo apt-get install git
-sudo apt-get install maven
+sudo apt-get install openjdk-7-jdk
 sudo apt-get install npm
 sudo apt-get install libfontconfig
+
+# install maven
+wget http://www.eu.apache.org/dist/maven/maven-3/3.3.3/binaries/apache-maven-3.3.3-bin.tar.gz
+sudo tar -zxf apache-maven-3.3.3-bin.tar.gz -C /usr/local/
+sudo ln -s /usr/local/apache-maven-3.3.3/bin/mvn /usr/local/bin/mvn
 ```
 
+_Notes:_ 
+ - Ensure node is installed by running `node --version`  
+ - Ensure maven is running version 3.1.x or higher with `mvn -version`
+
 ### Build
-If you want to build Zeppelin from the source, please first clone this repository. And then:
+If you want to build Zeppelin from the source, please first clone this repository, then:
+
 ```
 mvn clean package -DskipTests
 ```
 
-Build with specific Spark version
+To build with a specific Spark version, Hadoop version or specific features, define one or
more of the `spark`, `pyspark`, `hadoop` and `yarn` profiles, such as:
+
+```
+-Pspark-1.5   [Version to run in local spark mode]
+-Ppyspark     [optional: enable PYTHON support in spark via the %pyspark interpreter]
+-Pyarn        [optional: enable YARN support]
+-Dhadoop.version=2.2.0  [hadoop distribution]
+-Phadoop-2.2            [hadoop version]
+```
+
+Currently, final/full distributions run with:
+
+```
+mvn clean package -Pspark-1.5 -Phadoop-2.4 -Pyarn -Ppyspark
+```
 
 Spark 1.5.x
+
 ```
 mvn clean package -Pspark-1.5 -Dhadoop.version=2.2.0 -Phadoop-2.2 -DskipTests
 ```
 Spark 1.4.x
+
 ```
 mvn clean package -Pspark-1.4 -Dhadoop.version=2.2.0 -Phadoop-2.2 -DskipTests
 ```
 Spark 1.3.x
+
 ```
 mvn clean package -Pspark-1.3 -Dhadoop.version=2.2.0 -Phadoop-2.2 -DskipTests
 ```
 Spark 1.2.x
+
 ```
 mvn clean package -Pspark-1.2 -Dhadoop.version=2.2.0 -Phadoop-2.2 -DskipTests 
 ```
 Spark 1.1.x
+
 ```
 mvn clean package -Pspark-1.1 -Dhadoop.version=2.2.0 -Phadoop-2.2 -DskipTests 
 ```
 CDH 5.X
+
 ```
 mvn clean package -Pspark-1.2 -Dhadoop.version=2.5.0-cdh5.3.0 -Phadoop-2.4 -DskipTests
 ```
 Yarn (Hadoop 2.7.x)
+
 ```
 mvn clean package -Pspark-1.4 -Dspark.version=1.4.1 -Dhadoop.version=2.7.0 -Phadoop-2.6 -Pyarn
-DskipTests
 ```
 Yarn (Hadoop 2.6.x)
+
 ```
 mvn clean package -Pspark-1.1 -Dhadoop.version=2.6.0 -Phadoop-2.6 -Pyarn -DskipTests
 ```
 Yarn (Hadoop 2.4.x)
+
 ```
 mvn clean package -Pspark-1.1 -Dhadoop.version=2.4.0 -Phadoop-2.4 -Pyarn -DskipTests
 ```
 Yarn (Hadoop 2.3.x)
+
 ```
 mvn clean package -Pspark-1.1 -Dhadoop.version=2.3.0 -Phadoop-2.3 -Pyarn -DskipTests
 ```
 Yarn (Hadoop 2.2.x)
+
 ```
 mvn clean package -Pspark-1.1 -Dhadoop.version=2.2.0 -Phadoop-2.2 -Pyarn -DskipTests
 ```
 
 Ignite (1.1.0-incubating and later)
+
 ```
 mvn clean package -Dignite.version=1.1.0-incubating -DskipTests
 ```
 
 ### Configure
 If you wish to configure Zeppelin option (like port number), configure the following files:
+
 ```
 ./conf/zeppelin-env.sh
 ./conf/zeppelin-site.xml
@@ -140,9 +177,15 @@ Yarn
 For configuration details check __./conf__ subdirectory.
 
 ### Package
-To package final distribution do:
+To package the final distribution including the compressed archive, run:
+
+      mvn clean package -Pbuild-distr
+
+To build a distribution with specific profiles, run:
+
+      mvn clean package -Pbuild-distr -Pspark-1.5 -Phadoop-2.4 -Pyarn -Ppyspark
 
-      mvn clean package -P build-distr
+The profiles `-Pspark-1.5 -Phadoop-2.4 -Pyarn -Ppyspark` can be adjusted if you wish to build
to a specific spark versions, or omit support such as `yarn`.  
 
 The archive is generated under _zeppelin-distribution/target_ directory
 


Mime
View raw message