horn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shubham Mehta <shubham.meht...@gmail.com>
Subject Parallelizing SGD for CNN model
Date Tue, 13 Oct 2015 09:46:13 GMT
Hello, everyone

A very good read on parallelizing Convolutional Neural Network.

http://arxiv.org/abs/1404.5997

Apache Singa follows this approach specifically for CNN.

The gist of paper is that data parallelism is more beneficial for
Convolutional layers while model parallelism for fully-connected layers.


Regards
Shubam Mehta

-- 
Shubham Mehta
B.Tech 2015
Computer Science and Engineering
IIT Bombay

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message