singa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [singa] chrishkchris commented on issue #598: fix softmax nan problem
Date Wed, 12 Feb 2020 11:54:31 GMT
chrishkchris commented on issue #598: fix softmax nan problem
URL: https://github.com/apache/singa/pull/598#issuecomment-585170944
 
 
   I strongly support this change for two reasons:
   1. The current setting fails some network structure/dataset, which make the functions not
universal for all applications.
   2. SoftMax forward spent only very short time within the CNN training, e.g. resnet50 has
many conv layers but only one SoftMax layer, so the time spent in SoftMax is not the bottleneck.

   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message