singa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [singa] XJDKC opened a new pull request #598: fix softmax nan problem
Date Wed, 12 Feb 2020 11:45:22 GMT
XJDKC opened a new pull request #598: fix softmax nan problem
URL: https://github.com/apache/singa/pull/598
 
 
   Here I change the algorithm of the cudnnSoftmaxForward function.
   
   The original algorithm was CUDNN_SOFTMAX_FAST which may lead to overflow when the input
numbers are too large. Change it to CUDNN_SOFTMAX_ACCURATE will solve this problem.
   
   For example: If cudnn softmax is used in mlp.py, it will lead to this problem.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message