singa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xue Wanqi (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SINGA-387) Modified the design of autograd backward engine and correct some mistakes in it
Date Mon, 13 Aug 2018 05:55:00 GMT
Xue Wanqi created SINGA-387:
-------------------------------

             Summary: Modified the design of autograd backward engine and correct some mistakes
in it
                 Key: SINGA-387
                 URL: https://issues.apache.org/jira/browse/SINGA-387
             Project: Singa
          Issue Type: Improvement
            Reporter: Xue Wanqi


Old design of autograd engine will return intermediate gradients. We should avoid the happen
of that. For the parameters(tensors) need to store gradients, they or their creator should
know whether the gradients are calculated readily. and only when gradients are prepared then
they can be output.

Old design of autograd engine will store some unused gradient in dictionary not_ready. this
should be avoid as well in the new design.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message