mxnet-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] szha edited a comment on issue #13896: Cudnn dropout
Date Fri, 01 Feb 2019 04:11:20 GMT
szha edited a comment on issue #13896: Cudnn dropout
URL: https://github.com/apache/incubator-mxnet/pull/13896#issuecomment-458445531
 
 
   ~As of 7f76582 the speed-up still depends on the size of the input because of set descriptor
overhead. Since it’s a stateful op, it’s possible to utilize gluon’s static alloc +
static shape to avoid repeatedly setting dropout descriptor, but this solution is not general
or ideal. I'm currently looking into adding a runtime resource manager for sharing the dropout
state space to solve the overhead problem.~
   
   Update:
   I added the shared dropout states.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message