incubator-cvs mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <>
Subject [Incubator Wiki] Update of "SingaProposal" by ThejasNair
Date Mon, 02 Feb 2015 23:10:44 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Incubator Wiki" for change notification.

The "SingaProposal" page has been changed by ThejasNair:

updating related projects section

  Furthermore, the need for scalability for such a platform is obvious.
  === Relationship with Other Apache Products ===
+ Apache Mahout and Apache Spark's ML-LIB are general machine learning systems. Deep
+ learning algorithm can thus be implemented on these two platforms as well. However, the
there are differences in training efficiency, scalability and
+ usability. Mahout and Spark ML-LIB follow models where their
+ nodes run synchronously. This is the fundamental difference to Singa who
+ follows the parameter server framework (like Google Brain and Microsoft
+ Adam). Singa can run synchronously or asynchronously. The asynchronous mode
+ is superior than the synchronous mode in terms of scalability. In addition, Singa has some
optimizations towards deep learning models (e.g., model
+ parallelism, data parallelism and hybrid-parallelism) which make Singa
+ more efficient. We also provide ease of use programming model for deep
+ learning algorithms.
+ There are also plans for integration with Apache Hadoop's HDFS as storage, to  handle large
training data.
+ Specifically, we store the training data (e.g., images or raw features of
+ images) in HDFS, then (pre-)fetch them online.
+ We will also explore integration with Hadoop's Yarn and Apache Mesos to do resource management.
  == Documentation ==
  The project is hosted at

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message