singa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "wangwei (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SINGA-49) Fix a buf in HandlePutMsg func that sets param fields to invalid values
Date Sat, 08 Aug 2015 14:22:45 GMT
wangwei created SINGA-49:
----------------------------

             Summary: Fix a buf in HandlePutMsg func that sets param fields to invalid values
                 Key: SINGA-49
                 URL: https://issues.apache.org/jira/browse/SINGA-49
             Project: Singa
          Issue Type: Bug
            Reporter: wangwei


The Param::HandlePutMsg doesn't set the weight decay multiplier and learning rate multiplier
correctly. The current code doesn't use the values from the received messages. 

This bug is found when testing the CIFAR10 example. That example uses a large weight decay
for top layers to avoid over-fitting. The test is fine if parameters are updated at worker
side but gets over-fitting when parameters are updated at server side. The reason is that
the weight decay multiplier is not set properly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message