aurora-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From wfar...@apache.org
Subject svn commit: r1721273 - in /aurora/site: ./ publish/ publish/documentation/0.10.0/installing/ publish/documentation/latest/installing/ source/documentation/0.10.0/ source/documentation/latest/
Date Mon, 21 Dec 2015 22:14:24 GMT
Author: wfarner
Date: Mon Dec 21 22:14:24 2015
New Revision: 1721273

URL: http://svn.apache.org/viewvc?rev=1721273&view=rev
Log:
Sync with docs in git to fix anchor links.

Added:
    aurora/site/publish/documentation/0.10.0/installing/
    aurora/site/publish/documentation/0.10.0/installing/index.html
    aurora/site/source/documentation/0.10.0/installing.md
Modified:
    aurora/site/Rakefile
    aurora/site/publish/documentation/latest/installing/index.html
    aurora/site/publish/sitemap.xml
    aurora/site/source/documentation/latest/installing.md

Modified: aurora/site/Rakefile
URL: http://svn.apache.org/viewvc/aurora/site/Rakefile?rev=1721273&r1=1721272&r2=1721273&view=diff
==============================================================================
--- aurora/site/Rakefile (original)
+++ aurora/site/Rakefile Mon Dec 21 22:14:24 2015
@@ -119,9 +119,6 @@ task :generate_docs, [:title, :git_tag]
       })
     }
   }
-
-  puts '!!!!!'
-  puts 'Note: If you are adding docs for a new release, you should generate with the title
"latest" as well.'
 end
 
 desc 'Run the site in development mode. Preview available at http://localhost:4567/'

Added: aurora/site/publish/documentation/0.10.0/installing/index.html
URL: http://svn.apache.org/viewvc/aurora/site/publish/documentation/0.10.0/installing/index.html?rev=1721273&view=auto
==============================================================================
--- aurora/site/publish/documentation/0.10.0/installing/index.html (added)
+++ aurora/site/publish/documentation/0.10.0/installing/index.html Mon Dec 21 22:14:24 2015
@@ -0,0 +1,412 @@
+<!DOCTYPE html>
+<html lang="en">
+  <head>
+    <meta charset="utf-8">
+    <meta name="viewport" content="width=device-width, initial-scale=1">
+	<title>Apache Aurora</title>
+    <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.1/css/bootstrap.min.css">
+    <link href="/assets/css/main.css" rel="stylesheet">
+	<!-- Analytics -->
+	<script type="text/javascript">
+		  var _gaq = _gaq || [];
+		  _gaq.push(['_setAccount', 'UA-45879646-1']);
+		  _gaq.push(['_setDomainName', 'apache.org']);
+		  _gaq.push(['_trackPageview']);
+
+		  (function() {
+		    var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async =
true;
+		    ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') +
'.google-analytics.com/ga.js';
+		    var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s);
+		  })();
+	</script>
+  </head>
+  <body>
+    <div class="container-fluid section-header">
+  <div class="container">
+    <div class="nav nav-bar">
+    <a href="/"><img src="/assets/img/aurora_logo_dkbkg.svg" width="300" alt="Transparent
Apache Aurora logo with dark background"/></a>
+    <ul class="nav navbar-nav navbar-right">
+      <li><a href="/documentation/latest/">Documentation</a></li>
+      <li><a href="/community/">Community</a></li>
+      <li><a href="/downloads/">Downloads</a></li>
+      <li><a href="/blog/">Blog</a></li>
+    </ul>
+    </div>
+  </div>
+</div>
+	
+    <div class="container-fluid">
+      <div class="container content">
+        <div class="col-md-12 documentation">
+<h5 class="page-header text-uppercase">Documentation
+<select onChange="window.location.href='/documentation/' + this.value + '/installing/'"
+        value="0.10.0">
+  <option value="0.10.0"
+    selected="selected">
+    0.10.0
+      (latest)
+  </option>
+  <option value="0.9.0"
+    >
+    0.9.0
+  </option>
+  <option value="0.8.0"
+    >
+    0.8.0
+  </option>
+  <option value="0.7.0-incubating"
+    >
+    0.7.0-incubating
+  </option>
+  <option value="0.6.0-incubating"
+    >
+    0.6.0-incubating
+  </option>
+  <option value="0.5.0-incubating"
+    >
+    0.5.0-incubating
+  </option>
+</select>
+</h5>
+<h1 id="installing-aurora">Installing Aurora</h1>
+
+<ul>
+<li><a href="#components">Components</a>
+
+<ul>
+<li><a href="#machine-profiles">Machine profiles</a>
+
+<ul>
+<li><a href="#coordinator">Coordinator</a></li>
+<li><a href="#worker">Worker</a></li>
+<li><a href="#client">Client</a></li>
+</ul></li>
+</ul></li>
+<li><a href="#getting-aurora">Getting Aurora</a>
+
+<ul>
+<li><a href="#building-your-own-binary-packages">Building your own binary packages</a></li>
+<li><a href="#rpms">RPMs</a></li>
+</ul></li>
+<li><a href="#installing-the-scheduler">Installing the scheduler</a>
+
+<ul>
+<li><a href="#ubuntu-1404">Ubuntu 14.04</a></li>
+<li><a href="#centos-7">CentOS 7</a></li>
+<li><a href="#finalizing">Finalizing</a></li>
+<li><a href="#configuration">Configuration</a></li>
+</ul></li>
+<li><a href="#installing-worker-components">Installing worker components</a>
+
+<ul>
+<li><a href="#ubuntu-1404-1">Ubuntu 14.04</a></li>
+<li><a href="#centos-7-1">CentOS 7</a></li>
+<li><a href="#configuration-1">Configuration</a></li>
+</ul></li>
+<li><a href="#installing-the-client">Installing the client</a>
+
+<ul>
+<li><a href="#ubuntu-1404-2">Ubuntu 14.04</a></li>
+<li><a href="#centos-7-2">CentOS 7</a></li>
+<li><a href="#configuration-2">Configuration</a></li>
+</ul></li>
+<li><a href="#see-also">See also</a></li>
+<li><a href="#installing-mesos">Installing Mesos</a>
+
+<ul>
+<li><a href="#mesos-on-ubuntu-14-04">Mesos on Ubuntu 14.04</a></li>
+<li><a href="#mesos-on-centos-7">Mesos on CentOS 7</a></li>
+</ul></li>
+</ul>
+
+<h2 id="components">Components</h2>
+
+<p>Before installing Aurora, it&rsquo;s important to have an understanding of the
components that make up
+a functioning Aurora cluster.</p>
+
+<ul>
+<li><p><strong>Aurora scheduler</strong><br>
+The scheduler will be your primary interface to the work you run in your cluster.  You will
+instruct it to run jobs, and it will manage them in Mesos for you.  You will also frequently
use
+the scheduler&rsquo;s web interface as a heads-up display for what&rsquo;s running
in your cluster.</p></li>
+<li><p><strong>Aurora client</strong><br>
+The client (<code>aurora</code> command) is a command line tool that exposes
primitives that you can use to
+interact with the scheduler.</p></li>
+</ul>
+
+<p>Aurora also provides an admin client (<code>aurora_admin</code> command)
that contains commands built for
+  cluster administrators.  You can use this tool to do things like manage user quotas and
manage
+  graceful maintenance on machines in cluster.</p>
+
+<ul>
+<li><p><strong>Aurora executor</strong><br>
+The executor (a.k.a. Thermos executor) is responsible for carrying out the workloads described
in
+the Aurora DSL (<code>.aurora</code> files).  The executor is what actually executes
user processes.  It will
+also perform health checking of tasks and register tasks in ZooKeeper for the purposes of
dynamic
+service discovery.  You can find lots more detail on the executor and Thermos in the
+<a href="/documentation/0.10.0/user-guide/">user guide</a>.</p></li>
+<li><p><strong>Aurora observer</strong><br>
+The observer provides browser-based access to the status of individual tasks executing on
worker
+machines.  It gives insight into the processes executing, and facilitates browsing of task
sandbox
+directories.</p></li>
+<li><p><strong>ZooKeeper</strong><br>
+<a href="http://zookeeper.apache.org">ZooKeeper</a> is a distributed consensus
system.  In an Aurora cluster
+it is used for reliable election of the leading Aurora scheduler and Mesos master.</p></li>
+<li><p><strong>Mesos master</strong><br>
+The master is responsible for tracking worker machines and performing accounting of their
+resources.  The scheduler interfaces with the master to control the cluster.</p></li>
+<li><p><strong>Mesos agent</strong><br>
+The agent receives work assigned by the scheduler and executes them.  It interfaces with
Linux
+isolation systems like cgroups, namespaces and Docker to manage the resource consumption
of tasks.
+When a user task is launched, the agent will launch the executor (in the context of a Linux
cgroup
+or Docker container depending upon the environment), which will in turn fork user processes.</p></li>
+</ul>
+
+<h2 id="machine-profiles">Machine profiles</h2>
+
+<p>Given that many of these components communicate over the network, there are numerous
ways you could
+assemble them to create an Aurora cluster.  The simplest way is to think in terms of three
machine
+profiles:</p>
+
+<h3 id="coordinator">Coordinator</h3>
+
+<p><strong>Components</strong>: ZooKeeper, Aurora scheduler, Mesos master</p>
+
+<p>A small number of machines (typically 3 or 5) responsible for cluster orchestration.
 In most cases
+it is fine to co-locate these components in anything but very large clusters (&gt; 1000
machines).
+Beyond that point, operators will likely want to manage these services on separate machines.</p>
+
+<p>In practice, 5 coordinators have been shown to reliably manage clusters with tens
of thousands of
+machines.</p>
+
+<h3 id="worker">Worker</h3>
+
+<p><strong>Components</strong>: Aurora executor, Aurora observer, Mesos
agent</p>
+
+<p>The bulk of the cluster, where services will actually run.</p>
+
+<h3 id="client">Client</h3>
+
+<p><strong>Components</strong>: Aurora client, Aurora admin client</p>
+
+<p>Any machines that users submit jobs from.</p>
+
+<h2 id="getting-aurora">Getting Aurora</h2>
+
+<p>Source and binary distributions can be found on our
+<a href="https://aurora.apache.org/downloads/">downloads</a> page.  Installing
from binary packages is
+recommended for most.</p>
+
+<h3 id="building-your-own-binary-packages">Building your own binary packages</h3>
+
+<p>Our package build toolchain makes it easy to build your own packages if you would
like.  See the
+<a href="https://github.com/apache/aurora-packaging">instructions</a> to learn
how.</p>
+
+<h3 id="rpms">RPMs</h3>
+
+<p>We currently have work in progress to provide official RPMs.  As of this writing,
the suggested way
+to get RPMs is to <a href="#building-your-own-binary-packages">build them</a>.</p>
+
+<p>We do have unofficial experimental RPMs available for testing purposes.</p>
+
+<p><strong>Use these RPMs at your own risk, they are not officially released
under the ASF guidelines.</strong></p>
+<pre class="highlight plaintext"><code>echo '[apache-aurora-wfarner]
+name=Apache Aurora distribution maintained by wfarner
+baseurl=http://people.apache.org/~wfarner/aurora/distributions/0.9.0/rpm/centos-7/x86_64/
+gpgcheck = 0' | sudo tee /etc/yum.repos.d/apache-aurora-wfarner.repo &gt; /dev/null
+</code></pre>
+
+<h2 id="installing-the-scheduler">Installing the scheduler</h2>
+
+<h3 id="ubuntu-14-04">Ubuntu 14.04</h3>
+
+<ol>
+<li><p>Install Mesos<br>
+Skip down to <a href="#mesos-on-ubuntu-14-04">install mesos</a>, then run:</p>
+<pre class="highlight plaintext"><code>sudo start mesos-master
+</code></pre></li>
+<li><p>Install ZooKeeper</p>
+<pre class="highlight plaintext"><code>sudo apt-get install -y zookeeperd
+</code></pre></li>
+<li><p>Install the Aurora scheduler</p>
+<pre class="highlight plaintext"><code>wget -c https://apache.bintray.com/aurora/aurora-scheduler_0.10.0-1_amd64.deb
+sudo dpkg -i aurora-scheduler_0.10.0-1_amd64.deb
+</code></pre></li>
+</ol>
+
+<h3 id="centos-7">CentOS 7</h3>
+
+<ol>
+<li><p>Install Mesos<br>
+Skip down to <a href="#mesos-on-centos-7">install mesos</a>, then run:</p>
+<pre class="highlight plaintext"><code>sudo systemctl start mesos-master
+</code></pre></li>
+<li><p>Install ZooKeeper</p>
+<pre class="highlight plaintext"><code>sudo rpm -Uvh https://archive.cloudera.com/cdh4/one-click-install/redhat/6/x86_64/cloudera-cdh-4-0.x86_64.rpm
+sudo yum install -y java-1.8.0-openjdk-headless zookeeper-server
+
+sudo service zookeeper-server init
+sudo systemctl start zookeeper-server
+</code></pre></li>
+<li><p>Install the Aurora scheduler<br>
+If you haven&rsquo;t already, read the section on <a href="#rpms">how to get Aurora
RPMs</a>.</p>
+<pre class="highlight plaintext"><code># Note: for older Aurora RPM versions,
this may be called 'aurora'.
+sudo yum install -y aurora-scheduler
+</code></pre></li>
+</ol>
+
+<p>Note: if you are using the unreleased 0.9.0 RPM, you will need to edit <code>/etc/sysconfig/aurora</code>:<br>
+Change<br>
+<code>-mesos_master_address=&#39;zk://127.0.0.1:2181/mesos/master&#39;</code><br>
+To<br>
+<code>-mesos_master_address=&#39;zk://127.0.0.1:2181/mesos&#39;</code><br>
+And<br>
+<code>-native_log_file_path=&#39;/var/lib/aurora/db&#39;</code><br>
+To<br>
+<code>-native_log_file_path=&#39;/var/lib/aurora/scheduler/db&#39;</code></p>
+
+<h3 id="finalizing">Finalizing</h3>
+
+<p>By default, the scheduler will start in an uninitialized mode.  This is because
external
+coordination is necessary to be certain operator error does not result in a quorum of schedulers
+starting up and believing their databases are empty when in fact they should be re-joining
a
+cluster.</p>
+
+<p>Because of this, a fresh install of the scheduler will need intervention to start
up.  First,
+stop the scheduler service.<br>
+Ubuntu: <code>sudo stop aurora-scheduler</code><br>
+CentOS: <code>sudo systemctl stop aurora</code></p>
+
+<p>Now initialize the database:</p>
+<pre class="highlight plaintext"><code>sudo -u aurora mkdir -p /var/lib/aurora/scheduler/db
+sudo -u aurora mesos-log initialize --path=/var/lib/aurora/scheduler/db
+</code></pre>
+
+<p>Now you can start the scheduler back up.<br>
+Ubuntu: <code>sudo start aurora-scheduler</code><br>
+CentOS: <code>sudo systemctl start aurora</code></p>
+
+<h3 id="configuration">Configuration</h3>
+
+<p>For more detail on this topic, see the dedicated page on
+<a href="/documentation/0.10.0/deploying-aurora-scheduler/">deploying the scheduler</a></p>
+
+<h2 id="installing-worker-components">Installing worker components</h2>
+
+<h3 id="ubuntu-14-04">Ubuntu 14.04</h3>
+
+<ol>
+<li><p>Install Mesos<br>
+Skip down to <a href="#mesos-on-ubuntu-14-04">install mesos</a>, then run:</p>
+<pre class="highlight plaintext"><code>sudo start mesos-slave
+</code></pre></li>
+<li><p>Install Aurora executor and observer</p>
+<pre class="highlight plaintext"><code>wget -c https://apache.bintray.com/aurora/aurora-executor_0.10.0-1_amd64.deb
+sudo dpkg -i aurora-executor_0.10.0-1_amd64.deb
+</code></pre></li>
+</ol>
+
+<h3 id="centos-7">CentOS 7</h3>
+
+<ol>
+<li><p>Install Mesos<br>
+Skip down to <a href="#mesos-on-centos-7">install mesos</a>, then run:</p>
+<pre class="highlight plaintext"><code>sudo systemctl start mesos-slave
+</code></pre></li>
+<li><p>Install Aurora executor and observer<br>
+If you haven&rsquo;t already, read the section on <a href="#rpms">how to get Aurora
RPMs</a>.</p>
+<pre class="highlight plaintext"><code># Note: for older Aurora RPM versions,
this may be called 'aurora-thermos'.
+sudo yum install -y aurora-executor
+</code></pre></li>
+</ol>
+
+<h3 id="configuration">Configuration</h3>
+
+<p>The executor and observer typically do not require much configuration.  Command
line arguments can
+be passed to the executor using a command line argument on the scheduler.</p>
+
+<h2 id="installing-the-client">Installing the client</h2>
+
+<h3 id="ubuntu-14-04">Ubuntu 14.04</h3>
+<pre class="highlight plaintext"><code>sudo apt-get install -y python2.7 wget
+
+wget https://apache.bintray.com/aurora/aurora-tools_0.10.0-1_amd64.deb
+sudo dpkg -i aurora-tools_0.10.0-1_amd64.deb
+</code></pre>
+
+<h3 id="centos-7">CentOS 7</h3>
+
+<p>If you haven&rsquo;t already, read the section on <a href="#rpms">how
to get Aurora RPMs</a>.</p>
+<pre class="highlight plaintext"><code># Note: for older Aurora RPM versions,
this may be called 'aurora-client'.
+sudo yum install -y aurora-tools
+</code></pre>
+
+<h3 id="configuration">Configuration</h3>
+
+<p>Client configuration lives in a json file that describes the clusters available
and how to reach
+them.  By default this file is at <code>/etc/aurora/clusters.json</code>.</p>
+
+<p>Jobs may be submitted to the scheduler using the client, and are described with
+<a href="/documentation/0.10.0/configuration-reference/">job configurations</a>
expressed in <code>.aurora</code> files.  Typically you will
+maintain a single job configuration file to describe one or more deployment environments
(e.g.
+dev, test, prod) for a production job.</p>
+
+<h2 id="see-also">See also</h2>
+
+<p>We have other docs that you will find useful once you have your cluster up and running:
+* <a href="/documentation/0.10.0/monitoring/">Monitor</a> your cluster
+* Enable scheduler <a href="/documentation/0.10.0/security/">security</a>
+* View job SLA <a href="/documentation/0.10.0/sla/">statistics</a>
+* Understand the internals of the scheduler&rsquo;s <a href="/documentation/0.10.0/storage/">storage</a></p>
+
+<h2 id="installing-mesos">Installing Mesos</h2>
+
+<p>Mesos uses a single package for the Mesos master and slave.  As a result, the package
dependencies
+are identical for both.</p>
+
+<h3 id="mesos-on-ubuntu-14-04">Mesos on Ubuntu 14.04</h3>
+<pre class="highlight plaintext"><code>sudo add-apt-repository ppa:openjdk-r/ppa
-y
+sudo apt-get update
+
+sudo apt-get install -y software-properties-common wget libsvn1 libcurl3 openjdk-8-jre-headless
+
+wget -c http://downloads.mesosphere.io/master/ubuntu/14.04/mesos_0.23.0-1.0.ubuntu1404_amd64.deb
+sudo dpkg -i mesos_0.23.0-1.0.ubuntu1404_amd64.deb
+</code></pre>
+
+<h3 id="mesos-on-centos-7">Mesos on CentOS 7</h3>
+<pre class="highlight plaintext"><code>sudo rpm -Uvh http://repos.mesosphere.io/el/7/noarch/RPMS/mesosphere-el-repo-7-1.noarch.rpm
+sudo yum install -y mesos-0.22.0
+</code></pre>
+
+</div>
+
+      </div>
+    </div>
+  	<div class="container-fluid section-footer buffer">
+      <div class="container">
+        <div class="row">
+		  <div class="col-md-2 col-md-offset-1"><h3>Quick Links</h3>
+		  <ul>
+		    <li><a href="/downloads/">Downloads</a></li>
+            <li><a href="/community/">Mailing Lists</a></li>
+			<li><a href="http://issues.apache.org/jira/browse/AURORA">Issue Tracking</a></li>
+			<li><a href="/documentation/latest/contributing/">How To Contribute</a></li>
    
+		  </ul>
+	      </div>
+		  <div class="col-md-2"><h3>The ASF</h3>
+          <ul>
+            <li><a href="http://www.apache.org/licenses/">License</a></li>
+            <li><a href="http://www.apache.org/foundation/sponsorship.html">Sponsorship</a></li>
 
+            <li><a href="http://www.apache.org/foundation/thanks.html">Thanks</a></li>
+            <li><a href="http://www.apache.org/security/">Security</a></li>
+          </ul>
+		  </div>
+		  <div class="col-md-6">
+			<p class="disclaimer">Copyright 2014 <a href="http://www.apache.org/">Apache
Software Foundation</a>. Licensed under the <a href="http://www.apache.org/licenses/">Apache
License v2.0</a>. The <a href="https://www.flickr.com/photos/trondk/12706051375/">Aurora
Borealis IX photo</a> displayed on the homepage is available under a <a href="https://creativecommons.org/licenses/by-nc-nd/2.0/">Creative
Commons BY-NC-ND 2.0 license</a>. Apache, Apache Aurora, and the Apache feather logo
are trademarks of The Apache Software Foundation.</p>
+        </div>
+      </div>
+    </div>
+
+  </body>
+</html>

Modified: aurora/site/publish/documentation/latest/installing/index.html
URL: http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/installing/index.html?rev=1721273&r1=1721272&r2=1721273&view=diff
==============================================================================
--- aurora/site/publish/documentation/latest/installing/index.html (original)
+++ aurora/site/publish/documentation/latest/installing/index.html Mon Dec 21 22:14:24 2015
@@ -114,7 +114,7 @@
 <li><a href="#installing-mesos">Installing Mesos</a>
 
 <ul>
-<li><a href="#mesos-on-ubuntu-1404">Mesos on Ubuntu 14.04</a></li>
+<li><a href="#mesos-on-ubuntu-14-04">Mesos on Ubuntu 14.04</a></li>
 <li><a href="#mesos-on-centos-7">Mesos on CentOS 7</a></li>
 </ul></li>
 </ul>
@@ -222,7 +222,7 @@ gpgcheck = 0' | sudo tee /etc/yum.repos.
 
 <ol>
 <li><p>Install Mesos<br>
-Skip down to <a href="#mesos-on-ubuntu-1404">install mesos</a>, then run:</p>
+Skip down to <a href="#mesos-on-ubuntu-14-04">install mesos</a>, then run:</p>
 <pre class="highlight plaintext"><code>sudo start mesos-master
 </code></pre></li>
 <li><p>Install ZooKeeper</p>
@@ -297,7 +297,7 @@ CentOS: <code>sudo systemctl start auror
 
 <ol>
 <li><p>Install Mesos<br>
-Skip down to <a href="#mesos-on-ubuntu-1404">install mesos</a>, then run:</p>
+Skip down to <a href="#mesos-on-ubuntu-14-04">install mesos</a>, then run:</p>
 <pre class="highlight plaintext"><code>sudo start mesos-slave
 </code></pre></li>
 <li><p>Install Aurora executor and observer</p>

Modified: aurora/site/publish/sitemap.xml
URL: http://svn.apache.org/viewvc/aurora/site/publish/sitemap.xml?rev=1721273&r1=1721272&r2=1721273&view=diff
==============================================================================
--- aurora/site/publish/sitemap.xml (original)
+++ aurora/site/publish/sitemap.xml Mon Dec 21 22:14:24 2015
@@ -93,6 +93,10 @@
     <lastmod>2015-12-21T00:00:00+00:00</lastmod>
   </url>
   <url>
+    <loc>http://aurora.apache.org/documentation/0.10.0/installing/</loc>
+    <lastmod>2015-12-21T00:00:00+00:00</lastmod>
+  </url>
+  <url>
     <loc>http://aurora.apache.org/documentation/0.10.0/monitoring/</loc>
     <lastmod>2015-12-21T00:00:00+00:00</lastmod>
   </url>

Added: aurora/site/source/documentation/0.10.0/installing.md
URL: http://svn.apache.org/viewvc/aurora/site/source/documentation/0.10.0/installing.md?rev=1721273&view=auto
==============================================================================
--- aurora/site/source/documentation/0.10.0/installing.md (added)
+++ aurora/site/source/documentation/0.10.0/installing.md Mon Dec 21 22:14:24 2015
@@ -0,0 +1,271 @@
+# Installing Aurora
+
+- [Components](#components)
+    - [Machine profiles](#machine-profiles)
+      - [Coordinator](#coordinator)
+      - [Worker](#worker)
+      - [Client](#client)
+- [Getting Aurora](#getting-aurora)
+    - [Building your own binary packages](#building-your-own-binary-packages)
+    - [RPMs](#rpms)
+- [Installing the scheduler](#installing-the-scheduler)
+    - [Ubuntu 14.04](#ubuntu-1404)
+    - [CentOS 7](#centos-7)
+    - [Finalizing](#finalizing)
+    - [Configuration](#configuration)
+- [Installing worker components](#installing-worker-components)
+    - [Ubuntu 14.04](#ubuntu-1404-1)
+    - [CentOS 7](#centos-7-1)
+    - [Configuration](#configuration-1)
+- [Installing the client](#installing-the-client)
+    - [Ubuntu 14.04](#ubuntu-1404-2)
+    - [CentOS 7](#centos-7-2)
+    - [Configuration](#configuration-2)
+- [See also](#see-also)
+- [Installing Mesos](#installing-mesos)
+    - [Mesos on Ubuntu 14.04](#mesos-on-ubuntu-14-04)
+    - [Mesos on CentOS 7](#mesos-on-centos-7)
+
+## Components
+Before installing Aurora, it's important to have an understanding of the components that
make up
+a functioning Aurora cluster.
+
+* **Aurora scheduler**  
+  The scheduler will be your primary interface to the work you run in your cluster.  You
will
+  instruct it to run jobs, and it will manage them in Mesos for you.  You will also frequently
use
+  the scheduler's web interface as a heads-up display for what's running in your cluster.
+
+* **Aurora client**  
+  The client (`aurora` command) is a command line tool that exposes primitives that you can
use to
+  interact with the scheduler.
+
+  Aurora also provides an admin client (`aurora_admin` command) that contains commands built
for
+  cluster administrators.  You can use this tool to do things like manage user quotas and
manage
+  graceful maintenance on machines in cluster.
+
+* **Aurora executor**  
+  The executor (a.k.a. Thermos executor) is responsible for carrying out the workloads described
in
+  the Aurora DSL (`.aurora` files).  The executor is what actually executes user processes.
 It will
+  also perform health checking of tasks and register tasks in ZooKeeper for the purposes
of dynamic
+  service discovery.  You can find lots more detail on the executor and Thermos in the
+  [user guide](/documentation/0.10.0/user-guide/).
+
+* **Aurora observer**  
+  The observer provides browser-based access to the status of individual tasks executing
on worker
+  machines.  It gives insight into the processes executing, and facilitates browsing of task
sandbox
+  directories.
+
+* **ZooKeeper**  
+  [ZooKeeper](http://zookeeper.apache.org) is a distributed consensus system.  In an Aurora
cluster
+  it is used for reliable election of the leading Aurora scheduler and Mesos master.
+
+* **Mesos master**  
+  The master is responsible for tracking worker machines and performing accounting of their
+  resources.  The scheduler interfaces with the master to control the cluster.
+
+* **Mesos agent**  
+  The agent receives work assigned by the scheduler and executes them.  It interfaces with
Linux
+  isolation systems like cgroups, namespaces and Docker to manage the resource consumption
of tasks.
+  When a user task is launched, the agent will launch the executor (in the context of a Linux
cgroup
+  or Docker container depending upon the environment), which will in turn fork user processes.
+
+## Machine profiles
+Given that many of these components communicate over the network, there are numerous ways
you could
+assemble them to create an Aurora cluster.  The simplest way is to think in terms of three
machine
+profiles:
+
+### Coordinator
+**Components**: ZooKeeper, Aurora scheduler, Mesos master
+
+A small number of machines (typically 3 or 5) responsible for cluster orchestration.  In
most cases
+it is fine to co-locate these components in anything but very large clusters (> 1000 machines).
+Beyond that point, operators will likely want to manage these services on separate machines.
+
+In practice, 5 coordinators have been shown to reliably manage clusters with tens of thousands
of
+machines.
+
+
+### Worker
+**Components**: Aurora executor, Aurora observer, Mesos agent
+
+The bulk of the cluster, where services will actually run.
+
+### Client
+**Components**: Aurora client, Aurora admin client
+
+Any machines that users submit jobs from.
+
+## Getting Aurora
+Source and binary distributions can be found on our
+[downloads](https://aurora.apache.org/downloads/) page.  Installing from binary packages
is
+recommended for most.
+
+### Building your own binary packages
+Our package build toolchain makes it easy to build your own packages if you would like. 
See the
+[instructions](https://github.com/apache/aurora-packaging) to learn how.
+
+### RPMs
+We currently have work in progress to provide official RPMs.  As of this writing, the suggested
way
+to get RPMs is to [build them](#building-your-own-binary-packages).
+
+We do have unofficial experimental RPMs available for testing purposes.
+
+**Use these RPMs at your own risk, they are not officially released under the ASF guidelines.**
+
+    echo '[apache-aurora-wfarner]
+    name=Apache Aurora distribution maintained by wfarner
+    baseurl=http://people.apache.org/~wfarner/aurora/distributions/0.9.0/rpm/centos-7/x86_64/
+    gpgcheck = 0' | sudo tee /etc/yum.repos.d/apache-aurora-wfarner.repo > /dev/null
+
+
+## Installing the scheduler
+### Ubuntu 14.04
+
+1. Install Mesos  
+   Skip down to [install mesos](#mesos-on-ubuntu-14-04), then run:
+
+        sudo start mesos-master
+
+2. Install ZooKeeper
+
+        sudo apt-get install -y zookeeperd
+
+3. Install the Aurora scheduler
+
+        wget -c https://apache.bintray.com/aurora/aurora-scheduler_0.10.0-1_amd64.deb
+        sudo dpkg -i aurora-scheduler_0.10.0-1_amd64.deb
+
+### CentOS 7
+
+1. Install Mesos  
+   Skip down to [install mesos](#mesos-on-centos-7), then run:
+
+        sudo systemctl start mesos-master
+
+2. Install ZooKeeper
+
+        sudo rpm -Uvh https://archive.cloudera.com/cdh4/one-click-install/redhat/6/x86_64/cloudera-cdh-4-0.x86_64.rpm
+        sudo yum install -y java-1.8.0-openjdk-headless zookeeper-server
+
+        sudo service zookeeper-server init
+        sudo systemctl start zookeeper-server
+
+3. Install the Aurora scheduler  
+   If you haven't already, read the section on [how to get Aurora RPMs](#rpms).
+
+        # Note: for older Aurora RPM versions, this may be called 'aurora'.
+        sudo yum install -y aurora-scheduler
+
+Note: if you are using the unreleased 0.9.0 RPM, you will need to edit `/etc/sysconfig/aurora`:
 
+Change  
+`-mesos_master_address='zk://127.0.0.1:2181/mesos/master'`  
+To  
+`-mesos_master_address='zk://127.0.0.1:2181/mesos'`  
+And  
+`-native_log_file_path='/var/lib/aurora/db'`  
+To  
+`-native_log_file_path='/var/lib/aurora/scheduler/db'`
+
+### Finalizing
+By default, the scheduler will start in an uninitialized mode.  This is because external
+coordination is necessary to be certain operator error does not result in a quorum of schedulers
+starting up and believing their databases are empty when in fact they should be re-joining
a
+cluster.
+
+Because of this, a fresh install of the scheduler will need intervention to start up.  First,
+stop the scheduler service.  
+Ubuntu: `sudo stop aurora-scheduler`  
+CentOS: `sudo systemctl stop aurora`
+
+Now initialize the database:
+
+    sudo -u aurora mkdir -p /var/lib/aurora/scheduler/db
+    sudo -u aurora mesos-log initialize --path=/var/lib/aurora/scheduler/db
+
+Now you can start the scheduler back up.  
+Ubuntu: `sudo start aurora-scheduler`  
+CentOS: `sudo systemctl start aurora`
+
+### Configuration
+For more detail on this topic, see the dedicated page on
+[deploying the scheduler](/documentation/0.10.0/deploying-aurora-scheduler/)
+
+
+## Installing worker components
+### Ubuntu 14.04
+
+1. Install Mesos  
+   Skip down to [install mesos](#mesos-on-ubuntu-14-04), then run:
+
+        sudo start mesos-slave
+
+2. Install Aurora executor and observer
+
+        wget -c https://apache.bintray.com/aurora/aurora-executor_0.10.0-1_amd64.deb
+        sudo dpkg -i aurora-executor_0.10.0-1_amd64.deb
+
+### CentOS 7
+
+1. Install Mesos  
+   Skip down to [install mesos](#mesos-on-centos-7), then run:
+
+        sudo systemctl start mesos-slave
+
+2. Install Aurora executor and observer  
+   If you haven't already, read the section on [how to get Aurora RPMs](#rpms).
+
+        # Note: for older Aurora RPM versions, this may be called 'aurora-thermos'.
+        sudo yum install -y aurora-executor
+
+### Configuration
+The executor and observer typically do not require much configuration.  Command line arguments
can
+be passed to the executor using a command line argument on the scheduler.
+
+## Installing the client
+### Ubuntu 14.04
+
+    sudo apt-get install -y python2.7 wget
+
+    wget https://apache.bintray.com/aurora/aurora-tools_0.10.0-1_amd64.deb
+    sudo dpkg -i aurora-tools_0.10.0-1_amd64.deb
+
+### CentOS 7
+If you haven't already, read the section on [how to get Aurora RPMs](#rpms).
+
+    # Note: for older Aurora RPM versions, this may be called 'aurora-client'.
+    sudo yum install -y aurora-tools
+
+### Configuration
+Client configuration lives in a json file that describes the clusters available and how to
reach
+them.  By default this file is at `/etc/aurora/clusters.json`.
+
+Jobs may be submitted to the scheduler using the client, and are described with
+[job configurations](/documentation/0.10.0/configuration-reference/) expressed in `.aurora`
files.  Typically you will
+maintain a single job configuration file to describe one or more deployment environments
(e.g.
+dev, test, prod) for a production job.
+
+## See also
+We have other docs that you will find useful once you have your cluster up and running:
+* [Monitor](/documentation/0.10.0/monitoring/) your cluster
+* Enable scheduler [security](/documentation/0.10.0/security/)
+* View job SLA [statistics](/documentation/0.10.0/sla/)
+* Understand the internals of the scheduler's [storage](/documentation/0.10.0/storage/)
+
+## Installing Mesos
+Mesos uses a single package for the Mesos master and slave.  As a result, the package dependencies
+are identical for both.
+
+### Mesos on Ubuntu 14.04
+
+    sudo add-apt-repository ppa:openjdk-r/ppa -y
+    sudo apt-get update
+
+    sudo apt-get install -y software-properties-common wget libsvn1 libcurl3 openjdk-8-jre-headless
+
+    wget -c http://downloads.mesosphere.io/master/ubuntu/14.04/mesos_0.23.0-1.0.ubuntu1404_amd64.deb
+    sudo dpkg -i mesos_0.23.0-1.0.ubuntu1404_amd64.deb
+
+### Mesos on CentOS 7
+
+    sudo rpm -Uvh http://repos.mesosphere.io/el/7/noarch/RPMS/mesosphere-el-repo-7-1.noarch.rpm
+    sudo yum install -y mesos-0.22.0

Modified: aurora/site/source/documentation/latest/installing.md
URL: http://svn.apache.org/viewvc/aurora/site/source/documentation/latest/installing.md?rev=1721273&r1=1721272&r2=1721273&view=diff
==============================================================================
--- aurora/site/source/documentation/latest/installing.md (original)
+++ aurora/site/source/documentation/latest/installing.md Mon Dec 21 22:14:24 2015
@@ -23,7 +23,7 @@
     - [Configuration](#configuration-2)
 - [See also](#see-also)
 - [Installing Mesos](#installing-mesos)
-    - [Mesos on Ubuntu 14.04](#mesos-on-ubuntu-1404)
+    - [Mesos on Ubuntu 14.04](#mesos-on-ubuntu-14-04)
     - [Mesos on CentOS 7](#mesos-on-centos-7)
 
 ## Components
@@ -122,7 +122,7 @@ We do have unofficial experimental RPMs
 ### Ubuntu 14.04
 
 1. Install Mesos  
-   Skip down to [install mesos](#mesos-on-ubuntu-1404), then run:
+   Skip down to [install mesos](#mesos-on-ubuntu-14-04), then run:
 
         sudo start mesos-master
 
@@ -195,7 +195,7 @@ For more detail on this topic, see the d
 ### Ubuntu 14.04
 
 1. Install Mesos  
-   Skip down to [install mesos](#mesos-on-ubuntu-1404), then run:
+   Skip down to [install mesos](#mesos-on-ubuntu-14-04), then run:
 
         sudo start mesos-slave
 



Mime
View raw message