singa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jinyang Gao (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SINGA-83) Param Hashing
Date Tue, 06 Oct 2015 09:58:28 GMT
Jinyang Gao created SINGA-83:
--------------------------------

             Summary: Param Hashing
                 Key: SINGA-83
                 URL: https://issues.apache.org/jira/browse/SINGA-83
             Project: Singa
          Issue Type: Improvement
            Reporter: Jinyang Gao


Param hashing will be a very useful technique to reduce communication cost of deep learning
parameter. It can reduce the param size by 20x with little impact on model accuracy. Further
details can be seen in the following icml paper. Research problems can be done after the second
release.

http://arxiv.org/pdf/1504.04788.pdf
http://arxiv.org/pdf/1306.0543v2.pdf



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message