systemml-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias Boehm (JIRA)" <j...@apache.org>
Subject [jira] [Closed] (SYSTEMML-2132) Autoencoder over 100K x 10K input w/ unnecessary spark ops
Date Tue, 06 Feb 2018 19:32:00 GMT

     [ https://issues.apache.org/jira/browse/SYSTEMML-2132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Matthias Boehm closed SYSTEMML-2132.
------------------------------------
       Resolution: Fixed
         Assignee: Matthias Boehm
    Fix Version/s: SystemML 1.1

> Autoencoder over 100K x 10K input w/ unnecessary spark ops
> ----------------------------------------------------------
>
>                 Key: SYSTEMML-2132
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-2132
>             Project: SystemML
>          Issue Type: Bug
>            Reporter: Matthias Boehm
>            Assignee: Matthias Boehm
>            Priority: Major
>             Fix For: SystemML 1.1
>
>
> For a dense 100K x 10K input, the current auto encoder script results in unnecessary
spark operations for the initial permutation matrix multiply. After closer inspection this
is due to incorrect memory estimates for intermediates which is supposed to be a sparse but
returns a dense estimate.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message