singa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "wangwei (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SINGA-116) Fix a bug in InnerProductLayer caused by weight matrix sharing
Date Sun, 27 Dec 2015 14:34:49 GMT
wangwei created SINGA-116:
-----------------------------

             Summary: Fix a bug in InnerProductLayer caused by weight matrix sharing
                 Key: SINGA-116
                 URL: https://issues.apache.org/jira/browse/SINGA-116
             Project: Singa
          Issue Type: Bug
            Reporter: wangwei
            Assignee: wangwei


There is a bug in the implementation of InnerProductLayer, which appears when training the
auto-encoder example.
The weight matrix in inner-product layer in the encoder is shared by another layer in the
decoder. But the decoder uses transposed version.
The current code does not handle matrix transposition.

The bug can be fixed considering the transpose_ field explicitly.
We may later handle it implicitly using a Tensor class that handles transposition automatically.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message