singa-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From build...@apache.org
Subject svn commit: r986140 [15/34] - in /websites/staging/singa/trunk/content: ./ community/ develop/ docs/ docs/jp/ docs/kr/ docs/zh/ releases/ v0.1.0/ v0.2.0/ v0.2.0/jp/ v0.2.0/kr/ v0.2.0/zh/ v0.3.0/ v0.3.0/jp/ v0.3.0/kr/ v0.3.0/zh/
Date Wed, 20 Apr 2016 05:12:08 GMT
Added: websites/staging/singa/trunk/content/v0.3.0/jp/programming-guide.html
==============================================================================
--- websites/staging/singa/trunk/content/v0.3.0/jp/programming-guide.html (added)
+++ websites/staging/singa/trunk/content/v0.3.0/jp/programming-guide.html Wed Apr 20 05:12:03 2016
@@ -0,0 +1,410 @@
+<!DOCTYPE html>
+<!--
+ | Generated by Apache Maven Doxia at 2016-04-20 
+ | Rendered using Apache Maven Fluido Skin 1.4
+-->
+<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
+  <head>
+    <meta charset="UTF-8" />
+    <meta name="viewport" content="width=device-width, initial-scale=1.0" />
+    <meta name="Date-Revision-yyyymmdd" content="20160420" />
+    <meta http-equiv="Content-Language" content="en" />
+    <title>Apache SINGA &#x2013; Programming Guide</title>
+    <link rel="stylesheet" href="../../css/apache-maven-fluido-1.4.min.css" />
+    <link rel="stylesheet" href="../../css/site.css" />
+    <link rel="stylesheet" href="../../css/print.css" media="print" />
+
+      
+    
+    
+  
+    <script type="text/javascript" src="../../js/apache-maven-fluido-1.4.min.js"></script>
+
+                          
+        
+<script src="https://cdn.mathjax.org/mathjax/latest/MathJax.js?config=TeX-AMS-MML_HTMLorMML" type="text/javascript"></script>
+                      
+        
+<script type="text/x-mathjax-config">MathJax.Hub.Config({tex2jax: {inlineMath: [['$','$'], ['\\(','\\)']]}});</script>
+                      
+        
+<meta content="Apache SINGA" name="author"/>
+                      
+        
+<meta content="SINGA, Deep Learning, Distributed training" name="keywords"/>
+          
+                  </head>
+        <body class="topBarEnabled">
+          
+    
+    
+            
+    
+        
+    <a href="https://github.com/apache/incubator-singa">
+      <img style="position: absolute; top: 0; right: 0; border: 0; z-index: 10000;"
+        src="https://s3.amazonaws.com/github/ribbons/forkme_right_orange_ff7600.png"
+        alt="Fork me on GitHub">
+    </a>
+  
+                
+                    
+                
+
+    <div id="topbar" class="navbar navbar-fixed-top navbar-inverse">
+      <div class="navbar-inner">
+                <div class="container-fluid">
+        <a data-target=".nav-collapse" data-toggle="collapse" class="btn btn-navbar">
+          <span class="icon-bar"></span>
+          <span class="icon-bar"></span>
+          <span class="icon-bar"></span>
+        </a>
+                
+                                <ul class="nav">
+                          <li class="dropdown">
+        <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache SINGA <b class="caret"></b></a>
+        <ul class="dropdown-menu">
+        
+                      <li>      <a href="../../docs/overview.html"  title="Introduction">Introduction</a>
+</li>
+                  
+                      <li>      <a href="../../docs/quick-start.html"  title="Quick Start">Quick Start</a>
+</li>
+                  
+                      <li>      <a href="../../downloads.html"  title="Downloads">Downloads</a>
+</li>
+                          </ul>
+      </li>
+                <li class="dropdown">
+        <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentaion <b class="caret"></b></a>
+        <ul class="dropdown-menu">
+        
+                      <li class="dropdown-submenu">
+                                      <a href="../../docs/index.html"  title="v0.3.0">v0.3.0</a>
+              <ul class="dropdown-menu">
+                                  <li>      <a href="../../docs/index.html"  title="English">English</a>
+</li>
+                                  <li>      <a href="../../docs/zh/index.html"  title="中文">中文</a>
+</li>
+                                  <li>      <a href="../../docs/jp/index.html"  title="日本語">日本語</a>
+</li>
+                                  <li>      <a href="../../docs/kr/index.html"  title="한국어">한국어</a>
+</li>
+                              </ul>
+            </li>
+                  
+                      <li>      <a href="../../v0.2.0/index.html"  title="v0.2.0">v0.2.0</a>
+</li>
+                  
+                      <li>      <a href="../../v0.1.0/index.html"  title="v0.1.0">v0.1.0</a>
+</li>
+                          </ul>
+      </li>
+                <li class="dropdown">
+        <a href="#" class="dropdown-toggle" data-toggle="dropdown">Development <b class="caret"></b></a>
+        <ul class="dropdown-menu">
+        
+                      <li>      <a href="../../develop/schedule.html"  title="Schedule">Schedule</a>
+</li>
+                  
+                      <li class="dropdown-submenu">
+                                      <a href="../../develop/how-contribute.html"  title="How to Contribute">How to Contribute</a>
+              <ul class="dropdown-menu">
+                                  <li>      <a href="../../develop/contribute-code.html"  title="Code">Code</a>
+</li>
+                                  <li>      <a href="../../develop/contribute-docs.html"  title="Documentation">Documentation</a>
+</li>
+                              </ul>
+            </li>
+                          </ul>
+      </li>
+                <li class="dropdown">
+        <a href="#" class="dropdown-toggle" data-toggle="dropdown">Community <b class="caret"></b></a>
+        <ul class="dropdown-menu">
+        
+                      <li>      <a href="../../community/source-repository.html"  title="Source Repository">Source Repository</a>
+</li>
+                  
+                      <li>      <a href="../../community/mail-lists.html"  title="Mailing Lists">Mailing Lists</a>
+</li>
+                  
+                      <li>      <a href="../../community/issue-tracking.html"  title="Issue Tracking">Issue Tracking</a>
+</li>
+                  
+                      <li>      <a href="../../community/team-list.html"  title="SINGA Team">SINGA Team</a>
+</li>
+                          </ul>
+      </li>
+                <li class="dropdown">
+        <a href="#" class="dropdown-toggle" data-toggle="dropdown">External Links <b class="caret"></b></a>
+        <ul class="dropdown-menu">
+        
+                      <li>      <a href="http://www.apache.org/"  title="Apache Software Foundation">Apache Software Foundation</a>
+</li>
+                  
+                      <li>      <a href="http://www.comp.nus.edu.sg/~dbsystem/singa/"  title="NUS Site">NUS Site</a>
+</li>
+                          </ul>
+      </li>
+                  </ul>
+          
+          
+          
+                   
+                      </div>
+          
+        </div>
+      </div>
+    </div>
+    
+        <div class="container-fluid">
+          <div id="banner">
+        <div class="pull-left">
+                                                  <a href="../../index.html" id="bannerLeft" title="Apache SINGA">
+                                                                                                <img src="../../images/singa-logo.png"  alt="Apache SINGA"/>
+                </a>
+                      </div>
+        <div class="pull-right">              <div id="bannerRight">
+                                                                                                <img src="../../images/singa-title.png"  alt="Apache SINGA"/>
+                </div>
+      </div>
+        <div class="clear"><hr/></div>
+      </div>
+
+      <div id="breadcrumbs">
+        <ul class="breadcrumb">
+                
+                    
+                              <li class="">
+                    <a href="../../index.html" title="Apache SINGA">
+        Apache SINGA</a>
+                    <span class="divider">/</span>
+      </li>
+        <li class="active ">Programming Guide</li>
+        
+                
+                    
+      
+                            </ul>
+      </div>
+
+                  
+      <div class="row-fluid">
+        <div id="leftColumn" class="span2">
+          <div class="well sidebar-nav">
+                
+                    
+                <ul class="nav nav-list">
+                    <li class="nav-header">Apache SINGA</li>
+                              
+      <li>
+  
+                          <a href="../../docs/overview.html" title="Introduction">
+          <span class="none"></span>
+        Introduction</a>
+            </li>
+                
+      <li>
+  
+                          <a href="../../docs/quick-start.html" title="Quick Start">
+          <span class="none"></span>
+        Quick Start</a>
+            </li>
+                
+      <li>
+  
+                          <a href="../../downloads.html" title="Downloads">
+          <span class="none"></span>
+        Downloads</a>
+            </li>
+                              <li class="nav-header">Documentaion</li>
+                                                                                                                                      
+      <li>
+  
+                          <a href="../../docs/index.html" title="v0.3.0">
+          <span class="icon-chevron-right"></span>
+        v0.3.0</a>
+                  </li>
+                
+      <li>
+  
+                          <a href="../../v0.2.0/index.html" title="v0.2.0">
+          <span class="none"></span>
+        v0.2.0</a>
+            </li>
+                
+      <li>
+  
+                          <a href="../../v0.1.0/index.html" title="v0.1.0">
+          <span class="none"></span>
+        v0.1.0</a>
+            </li>
+                              <li class="nav-header">Development</li>
+                              
+      <li>
+  
+                          <a href="../../develop/schedule.html" title="Schedule">
+          <span class="none"></span>
+        Schedule</a>
+            </li>
+                                                                                    
+      <li>
+  
+                          <a href="../../develop/how-contribute.html" title="How to Contribute">
+          <span class="icon-chevron-right"></span>
+        How to Contribute</a>
+                  </li>
+                              <li class="nav-header">Community</li>
+                              
+      <li>
+  
+                          <a href="../../community/source-repository.html" title="Source Repository">
+          <span class="none"></span>
+        Source Repository</a>
+            </li>
+                
+      <li>
+  
+                          <a href="../../community/mail-lists.html" title="Mailing Lists">
+          <span class="none"></span>
+        Mailing Lists</a>
+            </li>
+                
+      <li>
+  
+                          <a href="../../community/issue-tracking.html" title="Issue Tracking">
+          <span class="none"></span>
+        Issue Tracking</a>
+            </li>
+                
+      <li>
+  
+                          <a href="../../community/team-list.html" title="SINGA Team">
+          <span class="none"></span>
+        SINGA Team</a>
+            </li>
+                              <li class="nav-header">External Links</li>
+                              
+      <li>
+  
+                          <a href="http://www.apache.org/" class="externalLink" title="Apache Software Foundation">
+          <span class="none"></span>
+        Apache Software Foundation</a>
+            </li>
+                
+      <li>
+  
+                          <a href="http://www.comp.nus.edu.sg/~dbsystem/singa/" class="externalLink" title="NUS Site">
+          <span class="none"></span>
+        NUS Site</a>
+            </li>
+            </ul>
+                
+                    
+                
+          <hr />
+
+           <div id="poweredBy">
+                            <div class="clear"></div>
+                            <div class="clear"></div>
+                            <div class="clear"></div>
+                            <div class="clear"></div>
+                                                                                                                   <a href="http://incubator.apache.org" title="apache-incubator" class="builtBy">
+        <img class="builtBy"  alt="Apache Incubator" src="http://incubator.apache.org/images/egg-logo.png"    />
+      </a>
+                      </div>
+          </div>
+        </div>
+        
+                        
+        <div id="bodyColumn"  class="span10" >
+                                  
+            <h1>Programming Guide</h1>
+<hr />
+<p>To submit a training job, users must provide the configuration of the four components shown in Figure 1:</p>
+
+<ul>
+  
+<li>a <a href="neural-net.html">NeuralNet</a> describing the neural net structure with the detailed layer setting and their connections;</li>
+  
+<li>a <a href="train-one-batch.html">TrainOneBatch</a> algorithm which is tailored for different model categories;</li>
+  
+<li>an <a href="updater.html">Updater</a> defining the protocol for updating parameters at the server side;</li>
+  
+<li>a <a href="distributed-training.html">Cluster Topology</a> specifying the distributed architecture of workers and servers.</li>
+</ul>
+<p>The <i>Basic user guide</i> section describes how to submit a training job using built-in components; while the <i>Advanced user guide</i> section presents details on writing user&#x2019;s own main function to register components implemented by themselves. In addition, the training data must be prepared, which has the same <a href="data.html">process</a> for both advanced users and basic users.</p>
+<p><img src="../../images/overview.png" align="center" width="400px" alt="" /> <span><b>Figure 1 - SINGA overview.</b></span></p>
+<div class="section">
+<h2><a name="Basic_user_guide"></a>Basic user guide</h2>
+<p>Users can use the default main function provided SINGA to submit the training job. For this case, a job configuration file written as a google protocol buffer message for the <a href="../api/classsinga_1_1JobProto.html">JobProto</a> must be provided in the command line,</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">./bin/singa-run.sh -conf &lt;path to job conf&gt; [-resume]
+</pre></div></div>
+<p><tt>-resume</tt> is for continuing the training from last <a href="checkpoint.html">checkpoint</a>. The <a href="mlp.html">MLP</a> and <a href="cnn.html">CNN</a> examples use built-in components. Please read the corresponding pages for their job configuration files. The subsequent pages will illustrate the details on each component of the configuration.</p></div>
+<div class="section">
+<h2><a name="Advanced_user_guide"></a>Advanced user guide</h2>
+<p>If a user&#x2019;s model contains some user-defined components, e.g., <a href="updater.html">Updater</a>, he has to write a main function to register these components. It is similar to Hadoop&#x2019;s main function. Generally, the main function should</p>
+
+<ul>
+  
+<li>
+<p>initialize SINGA, e.g., setup logging.</p></li>
+  
+<li>
+<p>register user-defined components.</p></li>
+  
+<li>
+<p>create and pass the job configuration to SINGA driver</p></li>
+</ul>
+<p>An example main function is like</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">#include &quot;singa.h&quot;
+#include &quot;user.h&quot;  // header for user code
+
+int main(int argc, char** argv) {
+  singa::Driver driver;
+  driver.Init(argc, argv);
+  bool resume;
+  // parse resume option from argv.
+
+  // register user defined layers
+  driver.RegisterLayer&lt;FooLayer&gt;(kFooLayer);
+  // register user defined updater
+  driver.RegisterUpdater&lt;FooUpdater&gt;(kFooUpdater);
+  ...
+  auto jobConf = driver.job_conf();
+  //  update jobConf
+
+  driver.Train(resume, jobConf);
+  return 0;
+}
+</pre></div></div>
+<p>The Driver class&#x2019; <tt>Init</tt> method will load a job configuration file provided by users as a command line argument (<tt>-conf &lt;job conf&gt;</tt>). It contains at least the cluster topology and returns the <tt>jobConf</tt> for users to update or fill in configurations of neural net, updater, etc. If users define subclasses of Layer, Updater, Worker and Param, they should register them through the driver. Finally, the job configuration is submitted to the driver which starts the training.</p>
+<p>We will provide helper functions to make the configuration easier in the future, like <a class="externalLink" href="https://github.com/fchollet/keras">keras</a>.</p>
+<p>Users need to compile and link their code (e.g., layer implementations and the main file) with SINGA library (<i>.libs/libsinga.so</i>) to generate an executable file, e.g., with name <i>mysinga</i>. To launch the program, users just pass the path of the <i>mysinga</i> and base job configuration to <i>./bin/singa-run.sh</i>.</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">./bin/singa-run.sh -conf &lt;path to job conf&gt; -exec &lt;path to mysinga&gt; [other arguments]
+</pre></div></div>
+<p>The <a href="rnn.html">RNN application</a> provides a full example of implementing the main function for training a specific RNN model.</p></div>
+                  </div>
+            </div>
+          </div>
+
+    <hr/>
+
+    <footer>
+            <div class="container-fluid">
+                      <div class="row-fluid">
+                                                                          
+<p>Copyright © 2015 The Apache Software Foundation. All rights reserved. Apache Singa, Apache, the Apache feather logo, and the Apache Singa project logos are trademarks of The Apache Software Foundation. All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
+                          </div>
+
+        
+                </div>
+    </footer>
+        </body>
+</html>

Added: websites/staging/singa/trunk/content/v0.3.0/jp/quick-start.html
==============================================================================
--- websites/staging/singa/trunk/content/v0.3.0/jp/quick-start.html (added)
+++ websites/staging/singa/trunk/content/v0.3.0/jp/quick-start.html Wed Apr 20 05:12:03 2016
@@ -0,0 +1,486 @@
+<!DOCTYPE html>
+<!--
+ | Generated by Apache Maven Doxia at 2016-04-20 
+ | Rendered using Apache Maven Fluido Skin 1.4
+-->
+<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
+  <head>
+    <meta charset="UTF-8" />
+    <meta name="viewport" content="width=device-width, initial-scale=1.0" />
+    <meta name="Date-Revision-yyyymmdd" content="20160420" />
+    <meta http-equiv="Content-Language" content="en" />
+    <title>Apache SINGA &#x2013; クイック スタート</title>
+    <link rel="stylesheet" href="../../css/apache-maven-fluido-1.4.min.css" />
+    <link rel="stylesheet" href="../../css/site.css" />
+    <link rel="stylesheet" href="../../css/print.css" media="print" />
+
+      
+    
+    
+  
+    <script type="text/javascript" src="../../js/apache-maven-fluido-1.4.min.js"></script>
+
+                          
+        
+<script src="https://cdn.mathjax.org/mathjax/latest/MathJax.js?config=TeX-AMS-MML_HTMLorMML" type="text/javascript"></script>
+                      
+        
+<script type="text/x-mathjax-config">MathJax.Hub.Config({tex2jax: {inlineMath: [['$','$'], ['\\(','\\)']]}});</script>
+                      
+        
+<meta content="Apache SINGA" name="author"/>
+                      
+        
+<meta content="SINGA, Deep Learning, Distributed training" name="keywords"/>
+          
+                  </head>
+        <body class="topBarEnabled">
+          
+    
+    
+            
+    
+        
+    <a href="https://github.com/apache/incubator-singa">
+      <img style="position: absolute; top: 0; right: 0; border: 0; z-index: 10000;"
+        src="https://s3.amazonaws.com/github/ribbons/forkme_right_orange_ff7600.png"
+        alt="Fork me on GitHub">
+    </a>
+  
+                
+                    
+                
+
+    <div id="topbar" class="navbar navbar-fixed-top navbar-inverse">
+      <div class="navbar-inner">
+                <div class="container-fluid">
+        <a data-target=".nav-collapse" data-toggle="collapse" class="btn btn-navbar">
+          <span class="icon-bar"></span>
+          <span class="icon-bar"></span>
+          <span class="icon-bar"></span>
+        </a>
+                
+                                <ul class="nav">
+                          <li class="dropdown">
+        <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache SINGA <b class="caret"></b></a>
+        <ul class="dropdown-menu">
+        
+                      <li>      <a href="../../docs/overview.html"  title="Introduction">Introduction</a>
+</li>
+                  
+                      <li>      <a href="../../docs/quick-start.html"  title="Quick Start">Quick Start</a>
+</li>
+                  
+                      <li>      <a href="../../downloads.html"  title="Downloads">Downloads</a>
+</li>
+                          </ul>
+      </li>
+                <li class="dropdown">
+        <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentaion <b class="caret"></b></a>
+        <ul class="dropdown-menu">
+        
+                      <li class="dropdown-submenu">
+                                      <a href="../../docs/index.html"  title="v0.3.0">v0.3.0</a>
+              <ul class="dropdown-menu">
+                                  <li>      <a href="../../docs/index.html"  title="English">English</a>
+</li>
+                                  <li>      <a href="../../docs/zh/index.html"  title="中文">中文</a>
+</li>
+                                  <li>      <a href="../../docs/jp/index.html"  title="日本語">日本語</a>
+</li>
+                                  <li>      <a href="../../docs/kr/index.html"  title="한국어">한국어</a>
+</li>
+                              </ul>
+            </li>
+                  
+                      <li>      <a href="../../v0.2.0/index.html"  title="v0.2.0">v0.2.0</a>
+</li>
+                  
+                      <li>      <a href="../../v0.1.0/index.html"  title="v0.1.0">v0.1.0</a>
+</li>
+                          </ul>
+      </li>
+                <li class="dropdown">
+        <a href="#" class="dropdown-toggle" data-toggle="dropdown">Development <b class="caret"></b></a>
+        <ul class="dropdown-menu">
+        
+                      <li>      <a href="../../develop/schedule.html"  title="Schedule">Schedule</a>
+</li>
+                  
+                      <li class="dropdown-submenu">
+                                      <a href="../../develop/how-contribute.html"  title="How to Contribute">How to Contribute</a>
+              <ul class="dropdown-menu">
+                                  <li>      <a href="../../develop/contribute-code.html"  title="Code">Code</a>
+</li>
+                                  <li>      <a href="../../develop/contribute-docs.html"  title="Documentation">Documentation</a>
+</li>
+                              </ul>
+            </li>
+                          </ul>
+      </li>
+                <li class="dropdown">
+        <a href="#" class="dropdown-toggle" data-toggle="dropdown">Community <b class="caret"></b></a>
+        <ul class="dropdown-menu">
+        
+                      <li>      <a href="../../community/source-repository.html"  title="Source Repository">Source Repository</a>
+</li>
+                  
+                      <li>      <a href="../../community/mail-lists.html"  title="Mailing Lists">Mailing Lists</a>
+</li>
+                  
+                      <li>      <a href="../../community/issue-tracking.html"  title="Issue Tracking">Issue Tracking</a>
+</li>
+                  
+                      <li>      <a href="../../community/team-list.html"  title="SINGA Team">SINGA Team</a>
+</li>
+                          </ul>
+      </li>
+                <li class="dropdown">
+        <a href="#" class="dropdown-toggle" data-toggle="dropdown">External Links <b class="caret"></b></a>
+        <ul class="dropdown-menu">
+        
+                      <li>      <a href="http://www.apache.org/"  title="Apache Software Foundation">Apache Software Foundation</a>
+</li>
+                  
+                      <li>      <a href="http://www.comp.nus.edu.sg/~dbsystem/singa/"  title="NUS Site">NUS Site</a>
+</li>
+                          </ul>
+      </li>
+                  </ul>
+          
+          
+          
+                   
+                      </div>
+          
+        </div>
+      </div>
+    </div>
+    
+        <div class="container-fluid">
+          <div id="banner">
+        <div class="pull-left">
+                                                  <a href="../../index.html" id="bannerLeft" title="Apache SINGA">
+                                                                                                <img src="../../images/singa-logo.png"  alt="Apache SINGA"/>
+                </a>
+                      </div>
+        <div class="pull-right">              <div id="bannerRight">
+                                                                                                <img src="../../images/singa-title.png"  alt="Apache SINGA"/>
+                </div>
+      </div>
+        <div class="clear"><hr/></div>
+      </div>
+
+      <div id="breadcrumbs">
+        <ul class="breadcrumb">
+                
+                    
+                              <li class="">
+                    <a href="../../index.html" title="Apache SINGA">
+        Apache SINGA</a>
+                    <span class="divider">/</span>
+      </li>
+        <li class="active ">クイック スタート</li>
+        
+                
+                    
+      
+                            </ul>
+      </div>
+
+                  
+      <div class="row-fluid">
+        <div id="leftColumn" class="span2">
+          <div class="well sidebar-nav">
+                
+                    
+                <ul class="nav nav-list">
+                    <li class="nav-header">Apache SINGA</li>
+                              
+      <li>
+  
+                          <a href="../../docs/overview.html" title="Introduction">
+          <span class="none"></span>
+        Introduction</a>
+            </li>
+                
+      <li>
+  
+                          <a href="../../docs/quick-start.html" title="Quick Start">
+          <span class="none"></span>
+        Quick Start</a>
+            </li>
+                
+      <li>
+  
+                          <a href="../../downloads.html" title="Downloads">
+          <span class="none"></span>
+        Downloads</a>
+            </li>
+                              <li class="nav-header">Documentaion</li>
+                                                                                                                                      
+      <li>
+  
+                          <a href="../../docs/index.html" title="v0.3.0">
+          <span class="icon-chevron-right"></span>
+        v0.3.0</a>
+                  </li>
+                
+      <li>
+  
+                          <a href="../../v0.2.0/index.html" title="v0.2.0">
+          <span class="none"></span>
+        v0.2.0</a>
+            </li>
+                
+      <li>
+  
+                          <a href="../../v0.1.0/index.html" title="v0.1.0">
+          <span class="none"></span>
+        v0.1.0</a>
+            </li>
+                              <li class="nav-header">Development</li>
+                              
+      <li>
+  
+                          <a href="../../develop/schedule.html" title="Schedule">
+          <span class="none"></span>
+        Schedule</a>
+            </li>
+                                                                                    
+      <li>
+  
+                          <a href="../../develop/how-contribute.html" title="How to Contribute">
+          <span class="icon-chevron-right"></span>
+        How to Contribute</a>
+                  </li>
+                              <li class="nav-header">Community</li>
+                              
+      <li>
+  
+                          <a href="../../community/source-repository.html" title="Source Repository">
+          <span class="none"></span>
+        Source Repository</a>
+            </li>
+                
+      <li>
+  
+                          <a href="../../community/mail-lists.html" title="Mailing Lists">
+          <span class="none"></span>
+        Mailing Lists</a>
+            </li>
+                
+      <li>
+  
+                          <a href="../../community/issue-tracking.html" title="Issue Tracking">
+          <span class="none"></span>
+        Issue Tracking</a>
+            </li>
+                
+      <li>
+  
+                          <a href="../../community/team-list.html" title="SINGA Team">
+          <span class="none"></span>
+        SINGA Team</a>
+            </li>
+                              <li class="nav-header">External Links</li>
+                              
+      <li>
+  
+                          <a href="http://www.apache.org/" class="externalLink" title="Apache Software Foundation">
+          <span class="none"></span>
+        Apache Software Foundation</a>
+            </li>
+                
+      <li>
+  
+                          <a href="http://www.comp.nus.edu.sg/~dbsystem/singa/" class="externalLink" title="NUS Site">
+          <span class="none"></span>
+        NUS Site</a>
+            </li>
+            </ul>
+                
+                    
+                
+          <hr />
+
+           <div id="poweredBy">
+                            <div class="clear"></div>
+                            <div class="clear"></div>
+                            <div class="clear"></div>
+                            <div class="clear"></div>
+                                                                                                                   <a href="http://incubator.apache.org" title="apache-incubator" class="builtBy">
+        <img class="builtBy"  alt="Apache Incubator" src="http://incubator.apache.org/images/egg-logo.png"    />
+      </a>
+                      </div>
+          </div>
+        </div>
+        
+                        
+        <div id="bodyColumn"  class="span10" >
+                                  
+            <h1>&#x30af;&#x30a4;&#x30c3;&#x30af; &#x30b9;&#x30bf;&#x30fc;&#x30c8;</h1>
+<hr />
+<div class="section">
+<h2><a name="SINGA_"></a>SINGA &#x30bb;&#x30c3;&#x30c8;&#x30a2;&#x30c3;&#x30d7;</h2>
+<p>SINGA&#x306e;&#x30a4;&#x30f3;&#x30b9;&#x30c8;&#x30fc;&#x30eb;&#x306b;&#x3064;&#x3044;&#x3066;&#x306f;<a href="installation.html">&#x3053;&#x3061;&#x3089;</a>&#x3092;&#x3054;&#x89a7;&#x304f;&#x3060;&#x3055;&#x3044;&#x3002;</p>
+<div class="section">
+<h3><a name="Zookeeper_"></a>Zookeeper &#x306e;&#x5b9f;&#x884c;</h3>
+<p>SINGA&#x306e;&#x30c8;&#x30ec;&#x30fc;&#x30cb;&#x30f3;&#x30b0;&#x306f;&#x3000;<a class="externalLink" href="https://zookeeper.apache.org/">zookeeper</a> &#x3092;&#x5229;&#x7528;&#x3057;&#x307e;&#x3059;&#x3002;&#x307e;&#x305a;&#x306f; zookeeper &#x30b5;&#x30fc;&#x30d3;&#x30b9;&#x304c;&#x958b;&#x59cb;&#x3055;&#x308c;&#x3066;&#x3044;&#x308b;&#x3053;&#x3068;&#x3092;&#x78ba;&#x8a8d;&#x3057;&#x3066;&#x304f;&#x3060;&#x3055;&#x3044;&#x3002;</p>
+<p>&#x6e96;&#x5099;&#x3055;&#x308c;&#x305f; thirdparty &#x306e;&#x30b9;&#x30af;&#x30ea;&#x30d7;&#x30c8;&#x3092;&#x4f7f;&#x3063;&#x3066; zookeeper &#x3092;&#x30a4;&#x30f3;&#x30b9;&#x30c8;&#x30fc;&#x30eb;&#x3057;&#x305f;&#x5834;&#x5408;&#x3001;&#x6b21;&#x306e;&#x30b9;&#x30af;&#x30ea;&#x30d7;&#x30c8;&#x3092;&#x5b9f;&#x884c;&#x3057;&#x3066;&#x304f;&#x3060;&#x3055;&#x3044;&#x3002;</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">#goto top level folder
+cd  SINGA_ROOT
+./bin/zk-service.sh start
+</pre></div></div>
+<p>(<tt>./bin/zk-service.sh stop</tt> // zookeeper &#x306e;&#x505c;&#x6b62;).</p>
+<p>&#x30c7;&#x30d5;&#x30a9;&#x30eb;&#x30c8;&#x306e;&#x30dd;&#x30fc;&#x30c8;&#x3092;&#x4f7f;&#x7528;&#x305b;&#x305a;&#x306b; zookeeper &#x3092;&#x30b9;&#x30bf;&#x30fc;&#x30c8;&#x3055;&#x305b;&#x308b;&#x6642;&#x306f;&#x3001;<tt>conf/singa.conf</tt>&#x3092;&#x7de8;&#x96c6;&#x3057;&#x3066;&#x304f;&#x3060;&#x3055;&#x3044;&#x3002;</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">zookeeper_host: &quot;localhost:YOUR_PORT&quot;
+</pre></div></div></div></div>
+<div class="section">
+<h2><a name="a"></a>&#x30b9;&#x30bf;&#x30f3;&#x30c9;&#x30a2;&#x30ed;&#x30fc;&#x30f3;&#x30e2;&#x30fc;&#x30c9;&#x3067;&#x306e;&#x5b9f;&#x884c;</h2>
+<p>&#x30b9;&#x30bf;&#x30f3;&#x30c9;&#x30a2;&#x30ed;&#x30fc;&#x30f3;&#x30e2;&#x30fc;&#x30c9;&#x3067;SINGA&#x3092;&#x5b9f;&#x884c;&#x3059;&#x308b;&#x3068;&#x306f;&#x3001;<a class="externalLink" href="http://mesos.apache.org/">Mesos</a> &#x3084; <a class="externalLink" href="http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/YARN.html">YARN</a> &#x306e;&#x3088;&#x3046;&#x306a;&#x30af;&#x30e9;&#x30b9;&#x30bf;&#x30fc;&#x30de;&#x30cd;&#x30fc;&#x30b8;&#x30e3;&#x30fc;&#x5229;&#x7528;&#x3057;&#x306a;&#x3044;&#x5834;&#x5408;&#x306e;&#x3053;&#x3068;&#x3092;&#x8a00;&#x3044;&#x307e;&#x3059;&#x3002;</p>
+<div class="section">
+<h3><a name="Single_"></a>Single &#x30ce;&#x30fc;&#x30c9;&#x3067;&#x306e;&#x30c8;&#x30ec;&#x30fc;&#x30cb;&#x30f3;&#x30b0;</h3>
+<p>&#xff11;&#x3064;&#x306e;&#x30d7;&#x30ed;&#x30bb;&#x30b9;&#x304c;&#x30ed;&#x30fc;&#x30f3;&#x30c1;&#x3055;&#x308c;&#x307e;&#x3059;&#x3002; &#x4f8b;&#x3068;&#x3057;&#x3066;&#x3001; <a class="externalLink" href="http://www.cs.toronto.edu/~kriz/cifar.html">CIFAR-10</a> &#x30c7;&#x30fc;&#x30bf;&#x30bb;&#x30c3;&#x30c8;&#x3092;&#x5229;&#x7528;&#x3057;&#x3066; <a class="externalLink" href="http://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks">CNN &#x30e2;&#x30c7;&#x30eb;</a> &#x3092;&#x30c8;&#x30ec;&#x30fc;&#x30cb;&#x30f3;&#x30b0;&#x3055;&#x305b;&#x307e;&#x3059;&#x3002; &#x30cf;&#x30a4;&#x30d1;&#x30fc;&#x30d1;&#x30e9;&#x30e1;&#x30fc;&#x30bf;&#x30fc;&#x306f;&#x3001;<a class="externalLink" href="https://code.google.com/p/cuda-convnet/">cuda-convnet</a> &#x306b;&#x57fa;&#x3065;&#x3044;&#x3066;&#x8a2d;&#x5b9a;&#x3055;&#x308c;&#x3066;&#x3042;&#x308a;&#x307e;&#x3059;&#x3002; &#x8a73;&#x7d30;&#x306f;&#x3001;<a href="cnn.html">CNN &#x30b5;&#x30f3;&#x30d
 7;&#x30eb;</a> &#x306e;&#x30da;&#x30fc;&#x30b8;&#x3092;&#x3054;&#x89a7;&#x304f;&#x3060;&#x3055;&#x3044;&#x3002;</p>
+<div class="section">
+<h4><a name="a"></a>&#x30c7;&#x30fc;&#x30bf;&#x3068;&#x3001;&#x30b8;&#x30e7;&#x30d6;&#x8a2d;&#x5b9a;</h4>
+<p>&#x30c7;&#x30fc;&#x30bf;&#x30bb;&#x30c3;&#x30c8;&#x306e;&#x30c0;&#x30a6;&#x30f3;&#x30ed;&#x30fc;&#x30c9;&#x3068;&#x3001;Triaing &#x3084; Test &#x306e;&#x305f;&#x3081;&#x306e;&#x30c7;&#x30fc;&#x30bf;&#x30b7;&#x30e3;&#x30fc;&#x30c9;&#x306e;&#x751f;&#x6210;&#x306f;&#x6b21;&#x306e;&#x3088;&#x3046;&#x306b;&#x884c;&#x3044;&#x307e;&#x3059;&#x3002;</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">cd examples/cifar10/
+cp Makefile.example Makefile
+make download
+make create
+</pre></div></div>
+<p>Training &#x3068; Test &#x30c7;&#x30fc;&#x30bf;&#x30bb;&#x30c3;&#x30c8;&#x306f;&#x3001;&#x305d;&#x308c;&#x305e;&#x308c; <i>cifar10-train-shard</i> &#x3068; <i>cifar10-test-shard</i> &#x30d5;&#x30a9;&#x30eb;&#x30c0;&#x30fc;&#x306b;&#x4f5c;&#x3089;&#x308c;&#x307e;&#x3059;&#x3002;&#x3000;&#x3059;&#x3079;&#x3066;&#x306e;&#x753b;&#x50cf;&#x306e;&#x7279;&#x5fb4;&#x5e73;&#x5747;&#x3092;&#x8a18;&#x8ff0;&#x3057;&#x305f; <i>image_mean.bin</i> &#x30d5;&#x30a1;&#x30a4;&#x30eb;&#x3082;&#x4f5c;&#x6210;&#x3055;&#x308c;&#x307e;&#x3059;&#x3002;</p>
+<p>CNN &#x30e2;&#x30c7;&#x30eb;&#x306e;&#x30c8;&#x30ec;&#x30fc;&#x30cb;&#x30f3;&#x30b0;&#x306b;&#x5fc5;&#x8981;&#x306a;&#x30bd;&#x30fc;&#x30b9;&#x30b3;&#x30fc;&#x30c9;&#x306f;&#x3059;&#x3079;&#x3066;SINGA&#x306b;&#x7d44;&#x307f;&#x8fbc;&#x307e;&#x308c;&#x3066;&#x3044;&#x307e;&#x3059;&#x3002;&#x30b3;&#x30fc;&#x30c9;&#x3092;&#x8ffd;&#x52a0;&#x3059;&#x308b;&#x5fc5;&#x8981;&#x306f;&#x3042;&#x308a;&#x307e;&#x305b;&#x3093;&#x3002; &#x30b8;&#x30e7;&#x30d6;&#x8a2d;&#x5b9a;&#x30d5;&#x30a1;&#x30a4;&#x30eb; (<i>job.conf</i>) &#x3092;&#x6307;&#x5b9a;&#x3057;&#x3066;&#x3001;&#x30b9;&#x30af;&#x30ea;&#x30d7;&#x30c8;(<i>../../bin/singa-run.sh</i>) &#x3092;&#x5b9f;&#x884c;&#x3057;&#x307e;&#x3059;&#x3002; SINGA&#x306e;&#x30b3;&#x30fc;&#x30c9;&#x3092;&#x5909;&#x66f4;&#x3001;&#x307e;&#x305f;&#x306f;&#x8ffd;&#x52a0;&#x3059;&#x308b;&#x6642;&#x306f;&#x3001;<a href="programming-guide.html">&#x30d7;&#x30ed;&#x30b0;&#x30e9;&#x30df;&#x30f3;&#x30b0;&#x30ac;&#x30a4;&#x30c9;</a>&#x3092;&#x3054;&#x89a7;&#x304f;&#
 x3060;&#x3055;&#x3044;&#x3002;</p></div>
+<div class="section">
+<h4><a name="a"></a>&#x4e26;&#x5217;&#x5316;&#x306a;&#x3057;&#x306e;&#x30c8;&#x30ec;&#x30fc;&#x30cb;&#x30f3;&#x30b0;</h4>
+<p>Cluster Topology &#x306e;&#x30c7;&#x30d5;&#x30a9;&#x30eb;&#x30c8;&#x5024;&#x306f;&#x3001;&#xff11;&#x3064;&#x306e; worker &#x3068;&#x3000;&#xff11;&#x3064;&#x306e; server &#x3068;&#x306a;&#x3063;&#x3066;&#x3044;&#x307e;&#x3059;&#x3002; &#x30c7;&#x30fc;&#x30bf;&#x3068;&#x30cb;&#x30e5;&#x30fc;&#x30e9;&#x30eb;&#x30cd;&#x30c3;&#x30c8;&#x306e;&#x4e26;&#x5217;&#x5316;&#x306f;&#x3055;&#x308c;&#x307e;&#x305b;&#x3093;&#x3002;</p>
+<p>&#x30c8;&#x30ec;&#x30fc;&#x30cb;&#x30f3;&#x30b0;&#x3092;&#x958b;&#x59cb;&#x3059;&#x308b;&#x306b;&#x306f;&#x6b21;&#x306e;&#x30b9;&#x30af;&#x30ea;&#x30d7;&#x30c8;&#x3092;&#x5b9f;&#x884c;&#x3057;&#x307e;&#x3059;&#x3002;</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint"># goto top level folder
+cd ../../
+./bin/singa-run.sh -conf examples/cifar10/job.conf
+</pre></div></div>
+<p>&#x73fe;&#x5728;&#x3001;&#x8d77;&#x52d5;&#x4e2d;&#x306e;&#x30b8;&#x30e7;&#x30d6;&#x306e;&#x30ea;&#x30b9;&#x30c8;&#x3092;&#x8868;&#x793a;&#x3059;&#x308b;&#x306b;&#x306f;</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">./bin/singa-console.sh list
+
+JOB ID    |NUM PROCS
+----------|-----------
+24        |1
+</pre></div></div>
+<p>&#x30b8;&#x30e7;&#x30d6;&#x306e;&#x5f37;&#x5236;&#x7d42;&#x4e86;&#x3092;&#x3059;&#x308b;&#x306b;&#x306f;</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">./bin/singa-console.sh kill JOB_ID
+</pre></div></div>
+<p>&#x30ed;&#x30b0;&#x3068;&#x30b8;&#x30e7;&#x30d6;&#x306e;&#x60c5;&#x5831;&#x306f; <i>/tmp/singa-log</i> &#x30d5;&#x30a9;&#x30eb;&#x30c0;&#x30fc;&#x306b;&#x4fdd;&#x5b58;&#x3055;&#x308c;&#x307e;&#x3059;&#x3002; <i>conf/singa.conf</i> &#x30d5;&#x30a1;&#x30a4;&#x30eb;&#x306e; <tt>log-dir</tt>&#x3067;&#x5909;&#x66f4;&#x53ef;&#x80fd;&#x3067;&#x3059;&#x3002;</p></div>
+<div class="section">
+<h4><a name="a"></a>&#x975e;&#x540c;&#x671f;&#x3001;&#x4e26;&#x5217;&#x30c8;&#x30ec;&#x30fc;&#x30cb;&#x30f3;&#x30b0;</h4>
+
+<div class="source">
+<div class="source"><pre class="prettyprint"># job.conf
+...
+cluster {
+  nworker_groups: 2
+  nworkers_per_procs: 2
+  workspace: &quot;examples/cifar10/&quot;
+}
+</pre></div></div>
+<p>&#x8907;&#x6570;&#x306e; worker &#x30b0;&#x30eb;&#x30fc;&#x30d7;&#x3092;&#x30ed;&#x30fc;&#x30f3;&#x30c1;&#x3059;&#x308b;&#x3053;&#x3068;&#x306b;&#x3088;&#x3063;&#x3066;&#x3001; In SINGA, <a href="architecture.html">&#x975e;&#x540c;&#x671f;&#x30c8;&#x30ec;&#x30fc;&#x30cb;&#x30f3;&#x30b0;</a> &#x3092;&#x5b9f;&#x884c;&#x3059;&#x308b;&#x3053;&#x3068;&#x304c;&#x51fa;&#x6765;&#x307e;&#x3059;&#x3002; &#x4f8b;&#x3048;&#x3070;&#x3001;<i>job.conf</i> &#x3092;&#x4e0a;&#x8a18;&#x306e;&#x3088;&#x3046;&#x306b;&#x5909;&#x66f4;&#x3057;&#x307e;&#x3059;&#x3002; &#x30c7;&#x30d5;&#x30a9;&#x30eb;&#x30c8;&#x3067;&#x306f;&#x3001;&#xff11;&#x3064;&#x306e; worker &#x30b0;&#x30eb;&#x30fc;&#x30d7;&#x304c;&#xff11;&#x3064;&#x306e; worker &#x3092;&#x6301;&#x3064;&#x3088;&#x3046;&#x8a2d;&#x5b9a;&#x3055;&#x308c;&#x3066;&#x3044;&#x307e;&#x3059;&#x3002; &#x4e0a;&#x8a18;&#x306e;&#x8a2d;&#x5b9a;&#x3067;&#x306f;&#x3001;&#xff11;&#x3064;&#x306e;&#x30d7;&#x30ed;&#x30bb;&#x30b9;&#x306b;&#xff12;&#x3064;&#x306e; worker &#x
 304c;&#x8a2d;&#x5b9a;&#x3055;&#x308c;&#x3066;&#x3044;&#x308b;&#x306e;&#x3067;&#x3001;&#xff12;&#x3064;&#x306e; worker &#x30b0;&#x30eb;&#x30fc;&#x30d7;&#x304c;&#x540c;&#x3058;&#x30d7;&#x30ed;&#x30bb;&#x30b9;&#x3068;&#x3057;&#x3066;&#x5b9f;&#x884c;&#x3055;&#x308c;&#x307e;&#x3059;&#x3002; &#x7d50;&#x679c;&#x3001;&#x30a4;&#x30f3;&#x30e1;&#x30e2;&#x30ea; <a href="frameworks.html">Downpour</a> &#x30c8;&#x30ec;&#x30fc;&#x30cb;&#x30f3;&#x30b0;&#x30d5;&#x30ec;&#x30fc;&#x30e0;&#x30ef;&#x30fc;&#x30af;&#x3068;&#x3057;&#x3066;&#x3001;&#x5b9f;&#x884c;&#x3055;&#x308c;&#x307e;&#x3059;&#x3002;</p>
+<p>&#x30e6;&#x30fc;&#x30b6;&#x30fc;&#x306f;&#x3001;&#x30c7;&#x30fc;&#x30bf;&#x306e;&#x5206;&#x6563;&#x3092;&#x6c17;&#x306b;&#x3059;&#x308b;&#x5fc5;&#x8981;&#x306f;&#x3042;&#x308a;&#x307e;&#x305b;&#x3093;&#x3002; &#x30e9;&#x30f3;&#x30c0;&#x30e0;&#x30aa;&#x30d5;&#x30bb;&#x30c3;&#x30c8;&#x306b;&#x5f93;&#x3044;&#x3001;&#x5404; worker &#x30b0;&#x30eb;&#x30fc;&#x30d7;&#x306b;&#x3001;&#x30c7;&#x30fc;&#x30bf;&#x304c;&#x632f;&#x308a;&#x5206;&#x3051;&#x3089;&#x308c;&#x307e;&#x3059;&#x3002; &#x5404; worker &#x306f;&#x7570;&#x306a;&#x308b;&#x30c7;&#x30fc;&#x30bf;&#x30d1;&#x30fc;&#x30c6;&#x30a3;&#x30b7;&#x30e7;&#x30f3;&#x3092;&#x62c5;&#x5f53;&#x3057;&#x307e;&#x3059;&#x3002;</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint"># job.conf
+...
+neuralnet {
+  layer {
+    ...
+    sharddata_conf {
+      random_skip: 5000
+    }
+  }
+  ...
+}
+</pre></div></div>
+<p>&#x30b9;&#x30af;&#x30ea;&#x30d7;&#x30c8;&#x5b9f;&#x884c;:</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">./bin/singa-run.sh -conf examples/cifar10/job.conf
+</pre></div></div></div>
+<div class="section">
+<h4><a name="a"></a>&#x540c;&#x671f;&#x3001;&#x4e26;&#x5217;&#x30c8;&#x30ec;&#x30fc;&#x30cb;&#x30f3;&#x30b0;</h4>
+
+<div class="source">
+<div class="source"><pre class="prettyprint"># job.conf
+...
+cluster {
+  nworkers_per_group: 2
+  nworkers_per_procs: 2
+  workspace: &quot;examples/cifar10/&quot;
+}
+</pre></div></div>
+<p>&#xff11;&#x3064;&#x306e;worker&#x30b0;&#x30eb;&#x30fc;&#x30d7;&#x3068;&#x3057;&#x3066;&#x8907;&#x6570;&#x306e;worker&#x3092;&#x30ed;&#x30fc;&#x30f3;&#x30c1;&#x3059;&#x308b;&#x3053;&#x3068;&#x3067; <a href="architecture.html">&#x540c;&#x671f;&#x30c8;&#x30ec;&#x30fc;&#x30cb;&#x30f3;&#x30b0;</a>&#x3092;&#x5b9f;&#x884c;&#x3059;&#x308b;&#x3053;&#x3068;&#x304c;&#x51fa;&#x6765;&#x307e;&#x3059;&#x3002; &#x4f8b;&#x3048;&#x3070;&#x3001;<i>job.conf</i> &#x30d5;&#x30a1;&#x30a4;&#x30eb;&#x3092;&#x4e0a;&#x8a18;&#x306e;&#x3088;&#x3046;&#x306b;&#x5909;&#x66f4;&#x3057;&#x307e;&#x3059;&#x3002; &#x4e0a;&#x8a18;&#x306e;&#x8a2d;&#x5b9a;&#x3067;&#x306f;&#x3001;&#xff11;&#x3064;&#x306e; worker &#x30b0;&#x30eb;&#x30fc;&#x30d7;&#x306b;&#xff12;&#x3064;&#x306e; worker &#x304c;&#x8a2d;&#x5b9a;&#x3055;&#x308c;&#x307e;&#x3057;&#x305f;&#x3002; worker &#x9054;&#x306f;&#x30b0;&#x30eb;&#x30fc;&#x30d7;&#x5185;&#x3067;&#x540c;&#x671f;&#x3057;&#x307e;&#x3059;&#x3002; &#x3053;&#x308c;&#x306f;&#x3001;&#x30a4;&#x30f3;&#
 x30e1;&#x30e2;&#x30ea; <a href="frameworks.html">sandblaster</a> &#x3068;&#x3057;&#x3066;&#x5b9f;&#x884c;&#x3055;&#x308c;&#x307e;&#x3059;&#x3002; &#x30e2;&#x30c7;&#x30eb;&#x306f;&#xff12;&#x3064;&#x306e;worker&#x306b;&#x5206;&#x5272;&#x3055;&#x308c;&#x307e;&#x3059;&#x3002;&#x5404;&#x30ec;&#x30a4;&#x30e4;&#x30fc;&#x304c;&#xff12;&#x3064;&#x306e;worker&#x306b;&#x632f;&#x308a;&#x5206;&#x3051;&#x3089;&#x308c;&#x307e;&#x3059;&#x3002; &#x632f;&#x308a;&#x5206;&#x3051;&#x3089;&#x308c;&#x305f;&#x30ec;&#x30a4;&#x30e4;&#x30fc;&#x306f;&#x30aa;&#x30ea;&#x30b8;&#x30ca;&#x30eb;&#x306e;&#x30ec;&#x30a4;&#x30e4;&#x30fc;&#x3068;&#x6a5f;&#x80fd;&#x306f;&#x540c;&#x3058;&#x3067;&#x3059;&#x304c;&#x3001;&#x7279;&#x5fb4;&#x30a4;&#x30f3;&#x30b9;&#x30bf;&#x30f3;&#x30b9;&#x306e;&#x6570;&#x304c; <tt>B/g</tt> &#x306b;&#x306a;&#x308a;&#x307e;&#x3059;&#x3002; &#x3053;&#x3053;&#x3067;&#x3001;<tt>B</tt>&#x306f;&#x30df;&#x30cb;&#x30d0;&#x30c3;&#x30c1;&#x306e;&#x30a4;&#x30f3;&#x30b9;&#x30bf;&#x30f3;&#x30b9;&#x306e;&#x65
 70;&#x3067;&#x3001;<tt>g</tt>&#x306f;&#x30b0;&#x30eb;&#x30fc;&#x30d7;&#x5185;&#x306e; worker &#x306e;&#x6570;&#x3067;&#x3059;&#x3002; <a href="neural-net.html">&#x5225;&#x306e;&#x30b9;&#x30ad;&#x30fc;&#x30e0;</a> &#x3092;&#x5229;&#x7528;&#x3057;&#x305f;&#x30ec;&#x30a4;&#x30e4;&#x30fc;&#xff08;&#x30cb;&#x30e5;&#x30fc;&#x30e9;&#x30eb;&#x30cd;&#x30c3;&#x30c8;&#x30ef;&#x30fc;&#x30af;&#xff09;&#x30d1;&#x30fc;&#x30c6;&#x30a3;&#x30b7;&#x30e7;&#x30f3;&#x65b9;&#x6cd5;&#x3082;&#x3042;&#x308a;&#x307e;&#x3059;&#x3002;</p>
+<p>&#x4ed6;&#x306e;&#x8a2d;&#x5b9a;&#x306f;&#x3059;&#x3079;&#x3066;&#x300c;&#x4e26;&#x5217;&#x5316;&#x306a;&#x3057;&#x300d;&#x306e;&#x5834;&#x5408;&#x3068;&#x540c;&#x3058;&#x3067;&#x3059;&#x3002;</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">./bin/singa-run.sh -conf examples/cifar10/job.conf
+</pre></div></div></div></div>
+<div class="section">
+<h3><a name="a"></a>&#x30af;&#x30e9;&#x30b9;&#x30bf;&#x4e0a;&#x3067;&#x306e;&#x30c8;&#x30ec;&#x30fc;&#x30cb;&#x30f3;&#x30b0;</h3>
+<p>&#x30af;&#x30e9;&#x30b9;&#x30bf;&#x30fc;&#x8a2d;&#x5b9a;&#x3092;&#x5909;&#x66f4;&#x3057;&#x3066;&#x3001;&#x4e0a;&#x8a18;&#x30c8;&#x30ec;&#x30fc;&#x30cb;&#x30f3;&#x30b0;&#x30d5;&#x30ec;&#x30fc;&#x30e0;&#x30ef;&#x30fc;&#x30af;&#x306e;&#x62e1;&#x5f35;&#x3092;&#x884c;&#x3044;&#x307e;&#x3059;&#x3002;</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">nworker_per_procs: 1
+</pre></div></div>
+<p>&#x3059;&#x3079;&#x3066;&#x306e;&#x30d7;&#x30ed;&#x30bb;&#x30b9;&#x306f;&#xff11;&#x3064;&#x306e;worker&#x30b9;&#x30ec;&#x30c3;&#x30c9;&#x3092;&#x751f;&#x6210;&#x3057;&#x307e;&#x3059;&#x3002; &#x7d50;&#x679c;&#x3001;worker &#x9054;&#x306f;&#x7570;&#x306a;&#x308b;&#x30d7;&#x30ed;&#x30bb;&#x30b9;&#xff08;&#x30ce;&#x30fc;&#x30c9;&#xff09;&#x5185;&#x3067;&#x751f;&#x6210;&#x3055;&#x308c;&#x307e;&#x3059;&#x3002; &#x30af;&#x30e9;&#x30b9;&#x30bf;&#x30fc;&#x5185;&#x306e;&#x30ce;&#x30fc;&#x30c9;&#x3092;&#x7279;&#x5b9a;&#x3059;&#x308b;&#x306b;&#x306f;&#x3001;<i>SINGA_ROOT/conf/</i> &#x306e; <i>hostfile</i> &#x306e;&#x8a2d;&#x5b9a;&#x304c;&#x5fc5;&#x8981;&#x3067;&#x3059;&#x3002;</p>
+<p>e.g.,</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">logbase-a01
+logbase-a02
+</pre></div></div>
+<p>zookeeper location &#x3082;&#x8a2d;&#x5b9a;&#x3059;&#x308b;&#x5fc5;&#x8981;&#x304c;&#x3042;&#x308a;&#x307e;&#x3059;&#x3002;</p>
+<p>e.g.,</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">#conf/singa.conf
+zookeeper_host: &quot;logbase-a01&quot;
+</pre></div></div>
+<p>&#x30b9;&#x30af;&#x30ea;&#x30d7;&#x30c8;&#x306e;&#x5b9f;&#x884c;&#x306f;&#x300c;Single &#x30ce;&#x30fc;&#x30c9; &#x30c8;&#x30ec;&#x30fc;&#x30cb;&#x30f3;&#x30b0;&#x300d;&#x3068;&#x540c;&#x3058;&#x3067;&#x3059;&#x3002;</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">./bin/singa-run.sh -conf examples/cifar10/job.conf
+</pre></div></div></div></div>
+<div class="section">
+<h2><a name="Mesos"></a>Mesos&#x3000;&#x3067;&#x306e;&#x5b9f;&#x884c;</h2>
+<p><i>working</i>&#x2026;</p></div>
+<div class="section">
+<h2><a name="a"></a>&#x6b21;&#x3078;</h2>
+<p>SINGA&#x306e;&#x30b3;&#x30fc;&#x30c9;&#x5909;&#x66f4;&#x3084;&#x8ffd;&#x52a0;&#x306b;&#x95a2;&#x3059;&#x308b;&#x8a73;&#x7d30;&#x306f;&#x3001;<a href="programming-guide.html">&#x30d7;&#x30ed;&#x30b0;&#x30e9;&#x30df;&#x30f3;&#x30b0;&#x30ac;&#x30a4;&#x30c9;</a> &#x3092;&#x3054;&#x89a7;&#x304f;&#x3060;&#x3055;&#x3044;&#x3002;</p></div>
+                  </div>
+            </div>
+          </div>
+
+    <hr/>
+
+    <footer>
+            <div class="container-fluid">
+                      <div class="row-fluid">
+                                                                          
+<p>Copyright © 2015 The Apache Software Foundation. All rights reserved. Apache Singa, Apache, the Apache feather logo, and the Apache Singa project logos are trademarks of The Apache Software Foundation. All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
+                          </div>
+
+        
+                </div>
+    </footer>
+        </body>
+</html>

Added: websites/staging/singa/trunk/content/v0.3.0/jp/rbm.html
==============================================================================
--- websites/staging/singa/trunk/content/v0.3.0/jp/rbm.html (added)
+++ websites/staging/singa/trunk/content/v0.3.0/jp/rbm.html Wed Apr 20 05:12:03 2016
@@ -0,0 +1,643 @@
+<!DOCTYPE html>
+<!--
+ | Generated by Apache Maven Doxia at 2016-04-20 
+ | Rendered using Apache Maven Fluido Skin 1.4
+-->
+<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
+  <head>
+    <meta charset="UTF-8" />
+    <meta name="viewport" content="width=device-width, initial-scale=1.0" />
+    <meta name="Date-Revision-yyyymmdd" content="20160420" />
+    <meta http-equiv="Content-Language" content="en" />
+    <title>Apache SINGA &#x2013; RBM Example</title>
+    <link rel="stylesheet" href="../../css/apache-maven-fluido-1.4.min.css" />
+    <link rel="stylesheet" href="../../css/site.css" />
+    <link rel="stylesheet" href="../../css/print.css" media="print" />
+
+      
+    
+    
+  
+    <script type="text/javascript" src="../../js/apache-maven-fluido-1.4.min.js"></script>
+
+                          
+        
+<script src="https://cdn.mathjax.org/mathjax/latest/MathJax.js?config=TeX-AMS-MML_HTMLorMML" type="text/javascript"></script>
+                      
+        
+<script type="text/x-mathjax-config">MathJax.Hub.Config({tex2jax: {inlineMath: [['$','$'], ['\\(','\\)']]}});</script>
+                      
+        
+<meta content="Apache SINGA" name="author"/>
+                      
+        
+<meta content="SINGA, Deep Learning, Distributed training" name="keywords"/>
+          
+                  </head>
+        <body class="topBarEnabled">
+          
+    
+    
+            
+    
+        
+    <a href="https://github.com/apache/incubator-singa">
+      <img style="position: absolute; top: 0; right: 0; border: 0; z-index: 10000;"
+        src="https://s3.amazonaws.com/github/ribbons/forkme_right_orange_ff7600.png"
+        alt="Fork me on GitHub">
+    </a>
+  
+                
+                    
+                
+
+    <div id="topbar" class="navbar navbar-fixed-top navbar-inverse">
+      <div class="navbar-inner">
+                <div class="container-fluid">
+        <a data-target=".nav-collapse" data-toggle="collapse" class="btn btn-navbar">
+          <span class="icon-bar"></span>
+          <span class="icon-bar"></span>
+          <span class="icon-bar"></span>
+        </a>
+                
+                                <ul class="nav">
+                          <li class="dropdown">
+        <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache SINGA <b class="caret"></b></a>
+        <ul class="dropdown-menu">
+        
+                      <li>      <a href="../../docs/overview.html"  title="Introduction">Introduction</a>
+</li>
+                  
+                      <li>      <a href="../../docs/quick-start.html"  title="Quick Start">Quick Start</a>
+</li>
+                  
+                      <li>      <a href="../../downloads.html"  title="Downloads">Downloads</a>
+</li>
+                          </ul>
+      </li>
+                <li class="dropdown">
+        <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentaion <b class="caret"></b></a>
+        <ul class="dropdown-menu">
+        
+                      <li class="dropdown-submenu">
+                                      <a href="../../docs/index.html"  title="v0.3.0">v0.3.0</a>
+              <ul class="dropdown-menu">
+                                  <li>      <a href="../../docs/index.html"  title="English">English</a>
+</li>
+                                  <li>      <a href="../../docs/zh/index.html"  title="中文">中文</a>
+</li>
+                                  <li>      <a href="../../docs/jp/index.html"  title="日本語">日本語</a>
+</li>
+                                  <li>      <a href="../../docs/kr/index.html"  title="한국어">한국어</a>
+</li>
+                              </ul>
+            </li>
+                  
+                      <li>      <a href="../../v0.2.0/index.html"  title="v0.2.0">v0.2.0</a>
+</li>
+                  
+                      <li>      <a href="../../v0.1.0/index.html"  title="v0.1.0">v0.1.0</a>
+</li>
+                          </ul>
+      </li>
+                <li class="dropdown">
+        <a href="#" class="dropdown-toggle" data-toggle="dropdown">Development <b class="caret"></b></a>
+        <ul class="dropdown-menu">
+        
+                      <li>      <a href="../../develop/schedule.html"  title="Schedule">Schedule</a>
+</li>
+                  
+                      <li class="dropdown-submenu">
+                                      <a href="../../develop/how-contribute.html"  title="How to Contribute">How to Contribute</a>
+              <ul class="dropdown-menu">
+                                  <li>      <a href="../../develop/contribute-code.html"  title="Code">Code</a>
+</li>
+                                  <li>      <a href="../../develop/contribute-docs.html"  title="Documentation">Documentation</a>
+</li>
+                              </ul>
+            </li>
+                          </ul>
+      </li>
+                <li class="dropdown">
+        <a href="#" class="dropdown-toggle" data-toggle="dropdown">Community <b class="caret"></b></a>
+        <ul class="dropdown-menu">
+        
+                      <li>      <a href="../../community/source-repository.html"  title="Source Repository">Source Repository</a>
+</li>
+                  
+                      <li>      <a href="../../community/mail-lists.html"  title="Mailing Lists">Mailing Lists</a>
+</li>
+                  
+                      <li>      <a href="../../community/issue-tracking.html"  title="Issue Tracking">Issue Tracking</a>
+</li>
+                  
+                      <li>      <a href="../../community/team-list.html"  title="SINGA Team">SINGA Team</a>
+</li>
+                          </ul>
+      </li>
+                <li class="dropdown">
+        <a href="#" class="dropdown-toggle" data-toggle="dropdown">External Links <b class="caret"></b></a>
+        <ul class="dropdown-menu">
+        
+                      <li>      <a href="http://www.apache.org/"  title="Apache Software Foundation">Apache Software Foundation</a>
+</li>
+                  
+                      <li>      <a href="http://www.comp.nus.edu.sg/~dbsystem/singa/"  title="NUS Site">NUS Site</a>
+</li>
+                          </ul>
+      </li>
+                  </ul>
+          
+          
+          
+                   
+                      </div>
+          
+        </div>
+      </div>
+    </div>
+    
+        <div class="container-fluid">
+          <div id="banner">
+        <div class="pull-left">
+                                                  <a href="../../index.html" id="bannerLeft" title="Apache SINGA">
+                                                                                                <img src="../../images/singa-logo.png"  alt="Apache SINGA"/>
+                </a>
+                      </div>
+        <div class="pull-right">              <div id="bannerRight">
+                                                                                                <img src="../../images/singa-title.png"  alt="Apache SINGA"/>
+                </div>
+      </div>
+        <div class="clear"><hr/></div>
+      </div>
+
+      <div id="breadcrumbs">
+        <ul class="breadcrumb">
+                
+                    
+                              <li class="">
+                    <a href="../../index.html" title="Apache SINGA">
+        Apache SINGA</a>
+                    <span class="divider">/</span>
+      </li>
+        <li class="active ">RBM Example</li>
+        
+                
+                    
+      
+                            </ul>
+      </div>
+
+                  
+      <div class="row-fluid">
+        <div id="leftColumn" class="span2">
+          <div class="well sidebar-nav">
+                
+                    
+                <ul class="nav nav-list">
+                    <li class="nav-header">Apache SINGA</li>
+                              
+      <li>
+  
+                          <a href="../../docs/overview.html" title="Introduction">
+          <span class="none"></span>
+        Introduction</a>
+            </li>
+                
+      <li>
+  
+                          <a href="../../docs/quick-start.html" title="Quick Start">
+          <span class="none"></span>
+        Quick Start</a>
+            </li>
+                
+      <li>
+  
+                          <a href="../../downloads.html" title="Downloads">
+          <span class="none"></span>
+        Downloads</a>
+            </li>
+                              <li class="nav-header">Documentaion</li>
+                                                                                                                                      
+      <li>
+  
+                          <a href="../../docs/index.html" title="v0.3.0">
+          <span class="icon-chevron-right"></span>
+        v0.3.0</a>
+                  </li>
+                
+      <li>
+  
+                          <a href="../../v0.2.0/index.html" title="v0.2.0">
+          <span class="none"></span>
+        v0.2.0</a>
+            </li>
+                
+      <li>
+  
+                          <a href="../../v0.1.0/index.html" title="v0.1.0">
+          <span class="none"></span>
+        v0.1.0</a>
+            </li>
+                              <li class="nav-header">Development</li>
+                              
+      <li>
+  
+                          <a href="../../develop/schedule.html" title="Schedule">
+          <span class="none"></span>
+        Schedule</a>
+            </li>
+                                                                                    
+      <li>
+  
+                          <a href="../../develop/how-contribute.html" title="How to Contribute">
+          <span class="icon-chevron-right"></span>
+        How to Contribute</a>
+                  </li>
+                              <li class="nav-header">Community</li>
+                              
+      <li>
+  
+                          <a href="../../community/source-repository.html" title="Source Repository">
+          <span class="none"></span>
+        Source Repository</a>
+            </li>
+                
+      <li>
+  
+                          <a href="../../community/mail-lists.html" title="Mailing Lists">
+          <span class="none"></span>
+        Mailing Lists</a>
+            </li>
+                
+      <li>
+  
+                          <a href="../../community/issue-tracking.html" title="Issue Tracking">
+          <span class="none"></span>
+        Issue Tracking</a>
+            </li>
+                
+      <li>
+  
+                          <a href="../../community/team-list.html" title="SINGA Team">
+          <span class="none"></span>
+        SINGA Team</a>
+            </li>
+                              <li class="nav-header">External Links</li>
+                              
+      <li>
+  
+                          <a href="http://www.apache.org/" class="externalLink" title="Apache Software Foundation">
+          <span class="none"></span>
+        Apache Software Foundation</a>
+            </li>
+                
+      <li>
+  
+                          <a href="http://www.comp.nus.edu.sg/~dbsystem/singa/" class="externalLink" title="NUS Site">
+          <span class="none"></span>
+        NUS Site</a>
+            </li>
+            </ul>
+                
+                    
+                
+          <hr />
+
+           <div id="poweredBy">
+                            <div class="clear"></div>
+                            <div class="clear"></div>
+                            <div class="clear"></div>
+                            <div class="clear"></div>
+                                                                                                                   <a href="http://incubator.apache.org" title="apache-incubator" class="builtBy">
+        <img class="builtBy"  alt="Apache Incubator" src="http://incubator.apache.org/images/egg-logo.png"    />
+      </a>
+                      </div>
+          </div>
+        </div>
+        
+                        
+        <div id="bodyColumn"  class="span10" >
+                                  
+            <h1>RBM Example</h1>
+<hr />
+<p>This example uses SINGA to train 4 RBM models and one auto-encoder model over the <a class="externalLink" href="http://yann.lecun.com/exdb/mnist/">MNIST dataset</a>. The auto-encoder model is trained to reduce the dimensionality of the MNIST image feature. The RBM models are trained to initialize parameters of the auto-encoder model. This example application is from <a class="externalLink" href="http://www.cs.toronto.edu/~hinton/science.pdf">Hinton&#x2019;s science paper</a>.</p>
+<div class="section">
+<h2><a name="Running_instructions"></a>Running instructions</h2>
+<p>Running scripts are provided in <i>SINGA_ROOT/examples/rbm</i> folder.</p>
+<p>The MNIST dataset has 70,000 handwritten digit images. The <a href="data.html">data preparation</a> page has details on converting this dataset into SINGA recognizable format. Users can simply run the following commands to download and convert the dataset.</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint"># at SINGA_ROOT/examples/mnist/
+$ cp Makefile.example Makefile
+$ make download
+$ make create
+</pre></div></div>
+<p>The training is separated into two phases, namely pre-training and fine-tuning. The pre-training phase trains 4 RBMs in sequence,</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint"># at SINGA_ROOT/
+$ ./bin/singa-run.sh -conf examples/rbm/rbm1.conf
+$ ./bin/singa-run.sh -conf examples/rbm/rbm2.conf
+$ ./bin/singa-run.sh -conf examples/rbm/rbm3.conf
+$ ./bin/singa-run.sh -conf examples/rbm/rbm4.conf
+</pre></div></div>
+<p>The fine-tuning phase trains the auto-encoder by,</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">$ ./bin/singa-run.sh -conf examples/rbm/autoencoder.conf
+</pre></div></div></div>
+<div class="section">
+<h2><a name="Training_details"></a>Training details</h2>
+<div class="section">
+<h3><a name="RBM1"></a>RBM1</h3>
+<p><img src="../images/example-rbm1.png" align="center" width="200px" alt="" /> <span><b>Figure 1 - RBM1.</b></span></p>
+<p>The neural net structure for training RBM1 is shown in Figure 1. The data layer and parser layer provides features for training RBM1. The visible layer (connected with parser layer) of RBM1 accepts the image feature (784 dimension). The hidden layer is set to have 1000 neurons (units). These two layers are configured as,</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">layer{
+  name: &quot;RBMVis&quot;
+  type: kRBMVis
+  srclayers:&quot;mnist&quot;
+  srclayers:&quot;RBMHid&quot;
+  rbm_conf{
+    hdim: 1000
+  }
+  param{
+    name: &quot;w1&quot;
+    init{
+      type: kGaussian
+      mean: 0.0
+      std: 0.1
+    }
+  }
+  param{
+    name: &quot;b11&quot;
+    init{
+      type: kConstant
+      value: 0.0
+    }
+  }
+}
+
+layer{
+  name: &quot;RBMHid&quot;
+  type: kRBMHid
+  srclayers:&quot;RBMVis&quot;
+  rbm_conf{
+    hdim: 1000
+  }
+  param{
+    name: &quot;w1_&quot;
+    share_from: &quot;w1&quot;
+  }
+  param{
+    name: &quot;b12&quot;
+    init{
+      type: kConstant
+      value: 0.0
+    }
+  }
+}
+</pre></div></div>
+<p>For RBM, the weight matrix is shared by the visible and hidden layers. For instance, <tt>w1</tt> is shared by <tt>vis</tt> and <tt>hid</tt> layers shown in Figure 1. In SINGA, we can configure the <tt>share_from</tt> field to enable <a href="param.html">parameter sharing</a> as shown above for the param <tt>w1</tt> and <tt>w1_</tt>.</p>
+<p><a href="train-one-batch.html#contrastive-divergence">Contrastive Divergence</a> is configured as the algorithm for <a href="train-one-batch.html">TrainOneBatch</a>. Following Hinton&#x2019;s paper, we configure the <a href="updater.html">updating protocol</a> as follows,</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint"># Updater Configuration
+updater{
+  type: kSGD
+  momentum: 0.2
+  weight_decay: 0.0002
+  learning_rate{
+    base_lr: 0.1
+    type: kFixed
+  }
+}
+</pre></div></div>
+<p>Since the parameters of RBM0 will be used to initialize the auto-encoder, we should configure the <tt>workspace</tt> field to specify a path for the checkpoint folder. For example, if we configure it as,</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">cluster {
+  workspace: &quot;examples/rbm/rbm1/&quot;
+}
+</pre></div></div>
+<p>Then SINGA will <a href="checkpoint.html">checkpoint the parameters</a> into <i>examples/rbm/rbm1/</i>.</p></div>
+<div class="section">
+<h3><a name="RBM1"></a>RBM1</h3>
+<p><img src="../images/example-rbm2.png" align="center" width="200px" alt="" /> <span><b>Figure 2 - RBM2.</b></span></p>
+<p>Figure 2 shows the net structure of training RBM2. The visible units of RBM2 accept the output from the Sigmoid1 layer. The Inner1 layer is a <tt>InnerProductLayer</tt> whose parameters are set to the <tt>w1</tt> and <tt>b12</tt> learned from RBM1. The neural net configuration is (with layers for data layer and parser layer omitted).</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">layer{
+  name: &quot;Inner1&quot;
+  type: kInnerProduct
+  srclayers:&quot;mnist&quot;
+  innerproduct_conf{
+    num_output: 1000
+  }
+  param{ name: &quot;w1&quot; }
+  param{ name: &quot;b12&quot;}
+}
+
+layer{
+  name: &quot;Sigmoid1&quot;
+  type: kSigmoid
+  srclayers:&quot;Inner1&quot;
+}
+
+layer{
+  name: &quot;RBMVis&quot;
+  type: kRBMVis
+  srclayers:&quot;Sigmoid1&quot;
+  srclayers:&quot;RBMHid&quot;
+  rbm_conf{
+    hdim: 500
+  }
+  param{
+    name: &quot;w2&quot;
+    ...
+  }
+  param{
+    name: &quot;b21&quot;
+    ...
+  }
+}
+
+layer{
+  name: &quot;RBMHid&quot;
+  type: kRBMHid
+  srclayers:&quot;RBMVis&quot;
+  rbm_conf{
+    hdim: 500
+  }
+  param{
+    name: &quot;w2_&quot;
+    share_from: &quot;w2&quot;
+  }
+  param{
+    name: &quot;b22&quot;
+    ...
+  }
+}
+</pre></div></div>
+<p>To load w0 and b02 from RBM0&#x2019;s checkpoint file, we configure the <tt>checkpoint_path</tt> as,</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">checkpoint_path: &quot;examples/rbm/rbm1/checkpoint/step6000-worker0&quot;
+cluster{
+  workspace: &quot;examples/rbm/rbm2&quot;
+}
+</pre></div></div>
+<p>The workspace is changed for checkpointing <tt>w2</tt>, <tt>b21</tt> and <tt>b22</tt> into <i>examples/rbm/rbm2/</i>.</p></div>
+<div class="section">
+<h3><a name="RBM3"></a>RBM3</h3>
+<p><img src="../images/example-rbm3.png" align="center" width="200px" alt="" /> <span><b>Figure 3 - RBM3.</b></span></p>
+<p>Figure 3 shows the net structure of training RBM3. In this model, a layer with 250 units is added as the hidden layer of RBM3. The visible units of RBM3 accepts output from Sigmoid2 layer. Parameters of Inner1 and Innner2 are set to <tt>w1,b12,w2,b22</tt> which can be load from the checkpoint file of RBM2, i.e., &#x201c;examples/rbm/rbm2/&#x201d;.</p></div>
+<div class="section">
+<h3><a name="RBM4"></a>RBM4</h3>
+<p><img src="../images/example-rbm4.png" align="center" width="200px" alt="" /> <span><b>Figure 4 - RBM4.</b></span></p>
+<p>Figure 4 shows the net structure of training RBM4. It is similar to Figure 3, but according to <a class="externalLink" href="http://www.cs.toronto.edu/~hinton/science.pdf">Hinton&#x2019;s science paper</a>, the hidden units of the top RBM (RBM4) have stochastic real-valued states drawn from a unit variance Gaussian whose mean is determined by the input from the RBM&#x2019;s logistic visible units. So we add a <tt>gaussian</tt> field in the RBMHid layer to control the sampling distribution (Gaussian or Bernoulli). In addition, this RBM has a much smaller learning rate (0.001). The neural net configuration for the RBM4 and the updating protocol is (with layers for data layer and parser layer omitted),</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint"># Updater Configuration
+updater{
+  type: kSGD
+  momentum: 0.9
+  weight_decay: 0.0002
+  learning_rate{
+    base_lr: 0.001
+    type: kFixed
+  }
+}
+
+layer{
+  name: &quot;RBMVis&quot;
+  type: kRBMVis
+  srclayers:&quot;Sigmoid3&quot;
+  srclayers:&quot;RBMHid&quot;
+  rbm_conf{
+    hdim: 30
+  }
+  param{
+    name: &quot;w4&quot;
+    ...
+  }
+  param{
+    name: &quot;b41&quot;
+    ...
+  }
+}
+
+layer{
+  name: &quot;RBMHid&quot;
+  type: kRBMHid
+  srclayers:&quot;RBMVis&quot;
+  rbm_conf{
+    hdim: 30
+    gaussian: true
+  }
+  param{
+    name: &quot;w4_&quot;
+    share_from: &quot;w4&quot;
+  }
+  param{
+    name: &quot;b42&quot;
+    ...
+  }
+}
+</pre></div></div></div>
+<div class="section">
+<h3><a name="Auto-encoder"></a>Auto-encoder</h3>
+<p>In the fine-tuning stage, the 4 RBMs are &#x201c;unfolded&#x201d; to form encoder and decoder networks that are initialized using the parameters from the previous 4 RBMs.</p>
+<p><img src="../images/example-autoencoder.png" align="center" width="500px" alt="" /> <span><b>Figure 5 - Auto-Encoders.</b></span></p>
+<p>Figure 5 shows the neural net structure for training the auto-encoder. <a href="train-one-batch.html">Back propagation (kBP)</a> is configured as the algorithm for <tt>TrainOneBatch</tt>. We use the same cluster configuration as RBM models. For updater, we use <a href="updater.html#adagradupdater">AdaGrad</a> algorithm with fixed learning rate.</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">### Updater Configuration
+updater{
+  type: kAdaGrad
+  learning_rate{
+  base_lr: 0.01
+  type: kFixed
+  }
+}
+</pre></div></div>
+<p>According to <a class="externalLink" href="http://www.cs.toronto.edu/~hinton/science.pdf">Hinton&#x2019;s science paper</a>, we configure a EuclideanLoss layer to compute the reconstruction error. The neural net configuration is (with some of the middle layers omitted),</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">layer{ name: &quot;data&quot; }
+layer{ name:&quot;mnist&quot; }
+layer{
+  name: &quot;Inner1&quot;
+  param{ name: &quot;w1&quot; }
+  param{ name: &quot;b12&quot; }
+}
+layer{ name: &quot;Sigmoid1&quot; }
+...
+layer{
+  name: &quot;Inner8&quot;
+  innerproduct_conf{
+    num_output: 784
+    transpose: true
+  }
+  param{
+    name: &quot;w8&quot;
+    share_from: &quot;w1&quot;
+  }
+  param{ name: &quot;b11&quot; }
+}
+layer{ name: &quot;Sigmoid8&quot; }
+
+# Euclidean Loss Layer Configuration
+layer{
+  name: &quot;loss&quot;
+  type:kEuclideanLoss
+  srclayers:&quot;Sigmoid8&quot;
+  srclayers:&quot;mnist&quot;
+}
+</pre></div></div>
+<p>To load pre-trained parameters from the 4 RBMs&#x2019; checkpoint file we configure <tt>checkpoint_path</tt> as</p>
+
+<div class="source">
+<div class="source"><pre class="prettyprint">### Checkpoint Configuration
+checkpoint_path: &quot;examples/rbm/checkpoint/rbm1/checkpoint/step6000-worker0&quot;
+checkpoint_path: &quot;examples/rbm/checkpoint/rbm2/checkpoint/step6000-worker0&quot;
+checkpoint_path: &quot;examples/rbm/checkpoint/rbm3/checkpoint/step6000-worker0&quot;
+checkpoint_path: &quot;examples/rbm/checkpoint/rbm4/checkpoint/step6000-worker0&quot;
+</pre></div></div></div></div>
+<div class="section">
+<h2><a name="Visualization_Results"></a>Visualization Results</h2>
+
+<div>
+<img src="../images/rbm-weight.PNG" align="center" width="300px" alt="" />
+
+<img src="../images/rbm-feature.PNG" align="center" width="300px" alt="" />
+<br />
+<span><b>Figure 6 - Bottom RBM weight matrix.</b></span>
+&#160;
+&#160;
+&#160;
+&#160;
+
+<span><b>Figure 7 - Top layer features.</b></span>
+</div>
+<p>Figure 6 visualizes sample columns of the weight matrix of RBM1, We can see the Gabor-like filters are learned. Figure 7 depicts the features extracted from the top-layer of the auto-encoder, wherein one point represents one image. Different colors represent different digits. We can see that most images are well clustered according to the ground truth.</p></div>
+                  </div>
+            </div>
+          </div>
+
+    <hr/>
+
+    <footer>
+            <div class="container-fluid">
+                      <div class="row-fluid">
+                                                                          
+<p>Copyright © 2015 The Apache Software Foundation. All rights reserved. Apache Singa, Apache, the Apache feather logo, and the Apache Singa project logos are trademarks of The Apache Software Foundation. All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
+                          </div>
+
+        
+                </div>
+    </footer>
+        </body>
+</html>



Mime
View raw message