singa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "wangwei (JIRA)" <>
Subject [jira] [Created] (SINGA-60) Make the learning rate change modular
Date Mon, 17 Aug 2015 15:37:46 GMT
wangwei created SINGA-60:

             Summary: Make the learning rate change modular
                 Key: SINGA-60
             Project: Singa
          Issue Type: Improvement
            Reporter: wangwei

The learning rate of SGD typically changes through time.
There are many different ways to change the learning rate of SGD. SINGA has implemented a
couple of changing methods. But users may want to implement their own changing method. To
make this part modular, this ticket is going to create a base learning rate generator called
LRGen, which is declared like,

class LRGen {
    virtual float operator() (int step) = 0;
   LRProto proto_;

Users can then inherit LRGen to implement the their own changing algorithm in the `operator()(int

Users can also add configurations for their generator by extending the base LRProto.

This message was sent by Atlassian JIRA

View raw message