flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-1994) Add different gain calculation schemes to SGD
Date Fri, 22 Jan 2016 10:13:39 GMT

    [ https://issues.apache.org/jira/browse/FLINK-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15112248#comment-15112248
] 

ASF GitHub Bot commented on FLINK-1994:
---------------------------------------

Github user chiwanpark commented on the pull request:

    https://github.com/apache/flink/pull/1397#issuecomment-173869263
  
    @tillrohrmann Thanks! It is good news.
    @rawkintrevo Thanks for contribution :+1: 


> Add different gain calculation schemes to SGD
> ---------------------------------------------
>
>                 Key: FLINK-1994
>                 URL: https://issues.apache.org/jira/browse/FLINK-1994
>             Project: Flink
>          Issue Type: Improvement
>          Components: Machine Learning Library
>            Reporter: Till Rohrmann
>            Assignee: Trevor Grant
>            Priority: Minor
>              Labels: ML, Starter
>
> The current SGD implementation uses as gain for the weight updates the formula {{stepsize/sqrt(iterationNumber)}}.
It would be good to make the gain calculation configurable and to provide different strategies
for that. For example:
> * stepsize/(1 + iterationNumber)
> * stepsize*(1 + regularization * stepsize * iterationNumber)^(-3/4)
> See also how to properly select the gains [1].
> Resources:
> [1] http://arxiv.org/pdf/1107.2490.pdf



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message