singa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "wangwei (JIRA)" <>
Subject [jira] [Updated] (SINGA-60) Make learning rate and param init modular
Date Wed, 19 Aug 2015 11:15:45 GMT


wangwei updated SINGA-60:
    Summary: Make learning rate and param init modular  (was: Make the learning rate changing
method modular)

> Make learning rate and param init modular
> -----------------------------------------
>                 Key: SINGA-60
>                 URL:
>             Project: Singa
>          Issue Type: Improvement
>            Reporter: wangwei
> The learning rate of SGD typically changes through time.
> There are many different ways to change the learning rate of SGD. SINGA has implemented
a couple of changing methods. But users may want to implement their own changing method. To
make this part modular, this ticket is going to create a base learning rate generator called
LRGen, which is declared like,
> {code}
> class LRGen {
>   public:
>     virtual float operator() (int step) = 0;
>   protected:
>    LRProto proto_;
> };
> {code}
> Users can then inherit LRGen to implement the their own changing algorithm in the `operator()(int
> Users can also add configurations for their generator by extending the base LRProto.

This message was sent by Atlassian JIRA

View raw message