singa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [incubator-singa] chrishkchris commented on issue #488: SINGA -475 add Sign operator to singa
Date Fri, 09 Aug 2019 09:47:45 GMT
chrishkchris commented on issue #488: SINGA -475 add Sign operator to singa
URL: https://github.com/apache/incubator-singa/pull/488#issuecomment-519856801
 
 
   In my opinion:
   For the function y=sign(x) , y = 1 when x > 0, y = -1 when x < 0. Therefore, the
derivative is 0 except x = 0. 
   The function y=sign(x) is discontinuous at x=0 where the derivative is undefined in the
mathematical logic. However, an defined derivative leads to a nan number, so we used a derivative
of zero also at x=0.
   
   As a result, dx is always 0 while the output shape (size of array) is the same as input
shape.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message