zeppelin-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From m...@apache.org
Subject svn commit: r1696621 - /incubator/zeppelin/site/docs/install/yarn_install.html
Date Wed, 19 Aug 2015 16:09:33 GMT
Author: moon
Date: Wed Aug 19 16:09:33 2015
New Revision: 1696621

URL: http://svn.apache.org/r1696621
Log:
https://github.com/apache/incubator-zeppelin/pull/225

Modified:
    incubator/zeppelin/site/docs/install/yarn_install.html

Modified: incubator/zeppelin/site/docs/install/yarn_install.html
URL: http://svn.apache.org/viewvc/incubator/zeppelin/site/docs/install/yarn_install.html?rev=1696621&r1=1696620&r2=1696621&view=diff
==============================================================================
--- incubator/zeppelin/site/docs/install/yarn_install.html (original)
+++ incubator/zeppelin/site/docs/install/yarn_install.html Wed Aug 19 16:09:33 2015
@@ -140,6 +140,14 @@
       
     
   
+    
+      
+    
+  
+    
+      
+    
+  
 
 
 
@@ -189,13 +197,21 @@
   
     
       
+      	
+      	<li><a href="/docs/index.html">Docs</a></li>
+      	
+      
     
   
     
       
-      	
-      	<li><a href="/docs/index.html">Docs</a></li>
-      	
+    
+  
+    
+      
+    
+  
+    
       
     
   
@@ -292,11 +308,10 @@
 su - zeppelin 
 whoami
 </code></pre></div>
-<p>Assuming a zeppelin user is created then running whoami command must return 
-<code>bash
-zeppelin
-</code>
-Its assumed in the rest of the document that zeppelin user is indeed created and below installation
instructions are performed as zeppelin user.</p>
+<p>Assuming a zeppelin user is created then running whoami command must return </p>
+<div class="highlight"><pre><code class="bash language-bash" data-lang="bash">zeppelin
+</code></pre></div>
+<p>Its assumed in the rest of the document that zeppelin user is indeed created and
below installation instructions are performed as zeppelin user.</p>
 
 <h3>List of Prerequisites</h3>
 
@@ -314,26 +329,23 @@ Its assumed in the rest of the document
 
 <h4>Git</h4>
 
-<p>Intall latest stable version of Git. This document describes installation of version
2.4.8
-<code>bash
-yum install curl-devel expat-devel gettext-devel openssl-devel zlib-devel
+<p>Intall latest stable version of Git. This document describes installation of version
2.4.8</p>
+<div class="highlight"><pre><code class="bash language-bash" data-lang="bash">yum
install curl-devel expat-devel gettext-devel openssl-devel zlib-devel
 yum install  gcc perl-ExtUtils-MakeMaker
 yum remove git
-cd /home/zeppelin/prerequisites
+<span class="nb">cd</span> /home/zeppelin/prerequisites
 wget https://github.com/git/git/archive/v2.4.8.tar.gz
 tar xzf git-2.0.4.tar.gz
-cd git-2.0.4
-make prefix=/home/zeppelin/prerequisites/git all
-make prefix=/home/zeppelin/prerequisites/git install
-echo &quot;export PATH=$PATH:/home/zeppelin/prerequisites/bin&quot; &gt;&gt;
/home/zeppelin/.bashrc
-source /home/zeppelin/.bashrc
+<span class="nb">cd </span>git-2.0.4
+make <span class="nv">prefix</span><span class="o">=</span>/home/zeppelin/prerequisites/git
all
+make <span class="nv">prefix</span><span class="o">=</span>/home/zeppelin/prerequisites/git
install
+<span class="nb">echo</span> <span class="s2">&quot;export PATH=$PATH:/home/zeppelin/prerequisites/bin&quot;</span>
&gt;&gt; /home/zeppelin/.bashrc
+<span class="nb">source</span> /home/zeppelin/.bashrc
 git --version
-</code>
-Assuming all the packages are successfully installed, running the version option with git
command should display
-<code>bash
-git version 2.4.8
-</code></p>
-
+</code></pre></div>
+<p>Assuming all the packages are successfully installed, running the version option
with git command should display</p>
+<div class="highlight"><pre><code class="bash language-bash" data-lang="bash">git
version 2.4.8
+</code></pre></div>
 <h4>Java</h4>
 
 <p>Zeppelin works well with 1.7.x version of Java runtime. Download JDK version 7 and
a stable update and follow below instructions to install it.</p>
@@ -344,34 +356,29 @@ tar -xf jdk-7u79-linux-x64.tar.gz
 <span class="nb">source</span> /home/zeppelin/.bashrc
 <span class="nb">echo</span> <span class="nv">$JAVA_HOME</span>
 </code></pre></div>
-<p>Assuming all the packages are successfully installed, echoing JAVA<em>HOME
environment variable should display
-```bash
-/home/zeppelin/prerequisites/jdk1.7.0</em>79
-```</p>
-
+<p>Assuming all the packages are successfully installed, echoing JAVA_HOME environment
variable should display</p>
+<div class="highlight"><pre><code class="bash language-bash" data-lang="bash">/home/zeppelin/prerequisites/jdk1.7.0_79
+</code></pre></div>
 <h4>Apache Maven</h4>
 
-<p>Download and install a stable version of Maven.
-<code>bash
-cd /home/zeppelin/prerequisites/
+<p>Download and install a stable version of Maven.</p>
+<div class="highlight"><pre><code class="bash language-bash" data-lang="bash"><span
class="nb">cd</span> /home/zeppelin/prerequisites/
 wget ftp://mirror.reverse.net/pub/apache/maven/maven-3/3.3.3/binaries/apache-maven-3.3.3-bin.tar.gz
 tar -xf apache-maven-3.3.3-bin.tar.gz 
-cd apache-maven-3.3.3
-export MAVEN_HOME=/home/zeppelin/prerequisites/apache-maven-3.3.3
-echo &quot;export PATH=$PATH:/home/zeppelin/prerequisites/apache-maven-3.3.3/bin&quot;
&gt;&gt; /home/zeppelin/.bashrc
-source /home/zeppelin/.bashrc
+<span class="nb">cd </span>apache-maven-3.3.3
+<span class="nb">export </span><span class="nv">MAVEN_HOME</span><span
class="o">=</span>/home/zeppelin/prerequisites/apache-maven-3.3.3
+<span class="nb">echo</span> <span class="s2">&quot;export PATH=$PATH:/home/zeppelin/prerequisites/apache-maven-3.3.3/bin&quot;</span>
&gt;&gt; /home/zeppelin/.bashrc
+<span class="nb">source</span> /home/zeppelin/.bashrc
 mvn -version
-</code>
-Assuming all the packages are successfully installed, running the version option with mvn
command should display
-<code>bash
-Apache Maven 3.3.3 (7994120775791599e205a5524ec3e0dfe41d4a06; 2015-04-22T04:57:37-07:00)
+</code></pre></div>
+<p>Assuming all the packages are successfully installed, running the version option
with mvn command should display</p>
+<div class="highlight"><pre><code class="bash language-bash" data-lang="bash">Apache
Maven 3.3.3 <span class="o">(</span>7994120775791599e205a5524ec3e0dfe41d4a06<span
class="p">;</span> 2015-04-22T04:57:37-07:00<span class="o">)</span>
 Maven home: /home/zeppelin/prerequisites/apache-maven-3.3.3
 Java version: 1.7.0_79, vendor: Oracle Corporation
 Java home: /home/zeppelin/prerequisites/jdk1.7.0_79/jre
 Default locale: en_US, platform encoding: UTF-8
-OS name: &quot;linux&quot;, version: &quot;2.6.32-358.el6.x86_64&quot;, arch:
&quot;amd64&quot;, family: &quot;unix&quot;
-</code></p>
-
+OS name: <span class="s2">&quot;linux&quot;</span>, version: <span
class="s2">&quot;2.6.32-358.el6.x86_64&quot;</span>, arch: <span class="s2">&quot;amd64&quot;</span>,
family: <span class="s2">&quot;unix&quot;</span>
+</code></pre></div>
 <h4>Hadoop client</h4>
 
 <p>Zeppelin can work with multiple versions &amp; distributions of Hadoop. A complete
list <a href="https://github.com/apache/incubator-zeppelin#build">is available here.</a>
This document assumes Hadoop 2.7.x client libraries including configuration files are installed
on Zeppelin node. It also assumes /etc/hadoop/conf contains various Hadoop configuration files.
The location of Hadoop configuration files may vary, hence use appropriate location.</p>
@@ -389,12 +396,11 @@ This <span class="nb">command </span>was
 
 <h2>Build</h2>
 
-<p>Checkout source code from <a href="https://github.com/apache/incubator-zeppelin">https://github.com/apache/incubator-zeppelin</a>
-<code>bash
-cd /home/zeppelin/
+<p>Checkout source code from <a href="https://github.com/apache/incubator-zeppelin">https://github.com/apache/incubator-zeppelin</a></p>
+<div class="highlight"><pre><code class="bash language-bash" data-lang="bash"><span
class="nb">cd</span> /home/zeppelin/
 git clone https://github.com/apache/incubator-zeppelin.git
-</code>
-Zeppelin package is available at /home/zeppelin/incubator-zeppelin after the checkout completes.</p>
+</code></pre></div>
+<p>Zeppelin package is available at /home/zeppelin/incubator-zeppelin after the checkout
completes.</p>
 
 <h3>Cluster mode</h3>
 
@@ -408,29 +414,26 @@ mvn clean package -Pspark-1.3 -Dspark.ve
 
 <h2>Zeppelin Configuration</h2>
 
-<p>Zeppelin configurations needs to be modified to connect to YARN cluster. Create
a copy of zeppelin environment XML
-<code>bash
-cp /home/zeppelin/incubator-zeppelin/conf/zeppelin-env.sh.template /home/zeppelin/incubator-zeppelin/conf/zeppelin-env.sh

-</code>
-Set the following properties
-<code>bash
-export JAVA_HOME=/home/zeppelin/prerequisites/jdk1.7.0_79
-export HADOOP_CONF_DIR=/etc/hadoop/conf
-export ZEPPELIN_PORT=10008
-export ZEPPELIN_JAVA_OPTS=&quot;-Dhdp.version=2.3.1.0-2574&quot;
-</code>
-As /etc/hadoop/conf contains various configurations of YARN cluster, Zeppelin can now submit
Spark/Hive jobs on YARN cluster form its web interface. The value of hdp.version is set to
2.3.1.0-2574. This can be obtained by running the following command
-```bash
-hdp-select status hadoop-client | sed &#39;s/hadoop-client - (.*)/\1/&#39;</p>
-
-<h1>It returned  2.3.1.0-2574</h1>
-<div class="highlight"><pre><code class="text language-text" data-lang="text">##
Start/Stop
-### Start Zeppelin
+<p>Zeppelin configurations needs to be modified to connect to YARN cluster. Create
a copy of zeppelin environment XML</p>
+<div class="highlight"><pre><code class="bash language-bash" data-lang="bash">cp
/home/zeppelin/incubator-zeppelin/conf/zeppelin-env.sh.template /home/zeppelin/incubator-zeppelin/conf/zeppelin-env.sh

 </code></pre></div>
-<p>cd /home/zeppelin/incubator-zeppelin
+<p>Set the following properties</p>
+<div class="highlight"><pre><code class="bash language-bash" data-lang="bash"><span
class="nb">export </span><span class="nv">JAVA_HOME</span><span class="o">=</span>/home/zeppelin/prerequisites/jdk1.7.0_79
+<span class="nb">export </span><span class="nv">HADOOP_CONF_DIR</span><span
class="o">=</span>/etc/hadoop/conf
+<span class="nb">export </span><span class="nv">ZEPPELIN_PORT</span><span
class="o">=</span>10008
+<span class="nb">export </span><span class="nv">ZEPPELIN_JAVA_OPTS</span><span
class="o">=</span><span class="s2">&quot;-Dhdp.version=2.3.1.0-2574&quot;</span>
+</code></pre></div>
+<p>As /etc/hadoop/conf contains various configurations of YARN cluster, Zeppelin can
now submit Spark/Hive jobs on YARN cluster form its web interface. The value of hdp.version
is set to 2.3.1.0-2574. This can be obtained by running the following command</p>
+<div class="highlight"><pre><code class="bash language-bash" data-lang="bash">hdp-select
status hadoop-client <span class="p">|</span> sed <span class="s1">&#39;s/hadoop-client
- \(.*\)/\1/&#39;</span>
+<span class="c"># It returned  2.3.1.0-2574</span>
+</code></pre></div>
+<h2>Start/Stop</h2>
+
+<h3>Start Zeppelin</h3>
+<div class="highlight"><pre><code class="text language-text" data-lang="text">cd
/home/zeppelin/incubator-zeppelin
 bin/zeppelin-daemon.sh start
-```
-After successful start, visit http://[zeppelin-server-host-name]:8080 with your web browser.</p>
+</code></pre></div>
+<p>After successful start, visit http://[zeppelin-server-host-name]:8080 with your
web browser.</p>
 
 <h3>Stop Zeppelin</h3>
 <div class="highlight"><pre><code class="text language-text" data-lang="text">bin/zeppelin-daemon.sh
stop



Mime
View raw message