horn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HORN-23) Add softmax function
Date Fri, 20 May 2016 09:02:12 GMT

    [ https://issues.apache.org/jira/browse/HORN-23?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15293034#comment-15293034
] 

Edward J. Yoon commented on HORN-23:
------------------------------------

I've added layer-wise API which can be used for computing intermediate output. and tried simple
MNIST test as below:

{code}
 η 0.01, α 0.9, λ 0.0005, 100 hidden units, and minibatch 10

16/05/20 16:29:10 INFO core.LayeredNeuralNetworkTrainer: Begin to train
16/05/20 16:30:37 INFO core.LayeredNeuralNetworkTrainer: Training error: 1.6391766522122924
at 100 iteration.
16/05/20 16:32:02 INFO core.LayeredNeuralNetworkTrainer: Training error: 0.9161898191464486
at 200 iteration.
16/05/20 16:33:23 INFO core.LayeredNeuralNetworkTrainer: Training error: 0.6965479470238546
at 300 iteration.
16/05/20 16:34:43 INFO core.LayeredNeuralNetworkTrainer: Training error: 0.5983155320123039
at 400 iteration.
16/05/20 16:36:06 INFO core.LayeredNeuralNetworkTrainer: Training error: 0.5296776599138799
at 500 iteration.
16/05/20 16:37:29 INFO core.LayeredNeuralNetworkTrainer: Training error: 0.5006024923915027
at 600 iteration.
16/05/20 16:38:47 INFO core.LayeredNeuralNetworkTrainer: Training error: 0.4620083988452511
at 700 iteration.
16/05/20 16:40:01 INFO core.LayeredNeuralNetworkTrainer: Training error: 0.43419631788875485
at 800 iteration.
16/05/20 16:41:24 INFO core.LayeredNeuralNetworkTrainer: Training error: 0.4197349700883643
at 900 iteration.
16/05/20 16:42:50 INFO core.LayeredNeuralNetworkTrainer: Training error: 0.40873442177996866
at 1000 iteration.
16/05/20 16:42:50 INFO core.LayeredNeuralNetworkTrainer: End of training, number of iterations:
1001.
16/05/20 16:42:50 INFO core.LayeredNeuralNetworkTrainer: Write model back to /tmp/model
16/05/20 16:42:50 INFO Configuration.deprecation: mapred.cache.localFiles is deprecated. Instead,
use mapreduce.job.cache.local.files
16/05/20 16:42:52 INFO examples.MNISTTest: Job Finished in 823.475 seconds
89.64143426294821%
{code}

> Add softmax function
> --------------------
>
>                 Key: HORN-23
>                 URL: https://issues.apache.org/jira/browse/HORN-23
>             Project: Apache Horn
>          Issue Type: New Feature
>            Reporter: Edward J. Yoon
>
> https://en.wikipedia.org/wiki/Softmax_function



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message