singa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SINGA-12) Supprt Checkpoint and Restore
Date Tue, 21 Jul 2015 13:57:05 GMT

    [ https://issues.apache.org/jira/browse/SINGA-12?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635150#comment-14635150
] 

ASF subversion and git services commented on SINGA-12:
------------------------------------------------------

Commit 189261f0e9f5e5dcd9233f5905b0af4750bd44b2 in incubator-singa's branch refs/heads/master
from wang sheng
[ https://git-wip-us.apache.org/repos/asf?p=incubator-singa.git;h=189261f ]

SINGA-12 Supprt Checkpoint and Restore

add utils/tinydir.h
edit makefile to include tinydir.h


> Supprt Checkpoint and Restore
> -----------------------------
>
>                 Key: SINGA-12
>                 URL: https://issues.apache.org/jira/browse/SINGA-12
>             Project: Singa
>          Issue Type: New Feature
>            Reporter: Sheng Wang
>            Assignee: Sheng Wang
>   Original Estimate: 504h
>  Remaining Estimate: 504h
>
> With the support of checkpoint, we can provide following features:
> 1. Failure Recovery: when a task is failed during the training, we can recover the task
from the latest checkpoint;
> 2. Continuous Training: when the user checks the trained model and finds that more steps
are needed, he can continue the training;
> 3. Parameter Reuse: from a previously trained model, we can create a new model by adding
new layers on top of it, and reuse the parameters during the training.
> The checkpoint should be done on the server side every few steps. In addition, a final
checkpoint will be made when the task is finished.
> During restore, the servers/workers will be firstly set up as normal, and after that
parameters will be loaded from the checkpoint file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message