incubator-cvs mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Incubator Wiki] Update of "SingaProposal" by ThejasNair
Date Mon, 02 Feb 2015 23:10:44 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Incubator Wiki" for change notification.

The "SingaProposal" page has been changed by ThejasNair:
https://wiki.apache.org/incubator/SingaProposal?action=diff&rev1=5&rev2=6

Comment:
updating related projects section

  Furthermore, the need for scalability for such a platform is obvious.
  
  === Relationship with Other Apache Products ===
+ Apache Mahout and Apache Spark's ML-LIB are general machine learning systems. Deep
+ learning algorithm can thus be implemented on these two platforms as well. However, the
there are differences in training efficiency, scalability and
+ usability. Mahout and Spark ML-LIB follow models where their
+ nodes run synchronously. This is the fundamental difference to Singa who
+ follows the parameter server framework (like Google Brain and Microsoft
+ Adam). Singa can run synchronously or asynchronously. The asynchronous mode
+ is superior than the synchronous mode in terms of scalability. In addition, Singa has some
optimizations towards deep learning models (e.g., model
+ parallelism, data parallelism and hybrid-parallelism) which make Singa
+ more efficient. We also provide ease of use programming model for deep
+ learning algorithms.
+ 
+ There are also plans for integration with Apache Hadoop's HDFS as storage, to  handle large
training data.
+ Specifically, we store the training data (e.g., images or raw features of
+ images) in HDFS, then (pre-)fetch them online.
+ We will also explore integration with Hadoop's Yarn and Apache Mesos to do resource management.
+ 
  
  == Documentation ==
  The project is hosted at http://www.comp.nus.edu.sg/~dbsystem/project/singa.html.

---------------------------------------------------------------------
To unsubscribe, e-mail: cvs-unsubscribe@incubator.apache.org
For additional commands, e-mail: cvs-help@incubator.apache.org


Mime
View raw message