mxnet-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [incubator-mxnet] zixuanweeei opened a new pull request #17183: [MKL-DNN][WIP] MKL-DNN RNN backward path enhancement
Date Fri, 27 Dec 2019 07:31:49 GMT
zixuanweeei opened a new pull request #17183: [MKL-DNN][WIP] MKL-DNN RNN backward path enhancement
URL: https://github.com/apache/incubator-mxnet/pull/17183
 
 
   ## Description ##
   Mainly aims to fix the gradients' explosion reported by https://github.com/apache/incubator-mxnet/issues/17086.
Other enhancements are also enabled, which are listed in the Changes section. 
   
   ## Checklist ##
   ### Changes ###
   * Flush memory before RNN backward primitive
   * Add gluon-rnn unit test for gradients check
   * Cache reorder
   * Re-write rnn supporting check
   * Update OpSignature.AddSign to avoid potential hash collision for rnn-packed memory
   
   ## Comments ##
   - Backward performance should have been improved to some degree as we cached the reorder
primitives. A performance comparison will be posted later. Besides, this patch is supposed
to have no impact on the Forward path.
   
   @ciyongch @TaoLv @pengzhao-intel 
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message