singa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SINGA-315) Reduce memory footprint by Python generator for parameter gradient
Date Thu, 01 Jun 2017 03:27:04 GMT

    [ https://issues.apache.org/jira/browse/SINGA-315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032375#comment-16032375
] 

ASF subversion and git services commented on SINGA-315:
-------------------------------------------------------

Commit 4e7db0545c68d52ed51bc14f8a8448e3617ba86f in incubator-singa's branch refs/heads/master
from [~flytosky]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-singa.git;h=4e7db05 ]

SINGA-315 - Reduce memory footprint by Python generator for parameter gradient

Fixed a bug in net::train() function which missed the gradient argument
when calling backward().


> Reduce memory footprint by Python generator for parameter gradient
> ------------------------------------------------------------------
>
>                 Key: SINGA-315
>                 URL: https://issues.apache.org/jira/browse/SINGA-315
>             Project: Singa
>          Issue Type: New Feature
>            Reporter: wangwei
>
> The parameter gradient tensors are stored in memory until BP is finished.
> This is not necessary as we can update the parameter once its gradient is ready. Then
we free the gradient tensor. 
> In this way, we reduce the memory footprint by avoiding store all gradient tensors.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message