systemml-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias Boehm (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (SYSTEMML-1838) Performance issues sparse/ultra-sparse binary read
Date Tue, 15 Aug 2017 20:05:01 GMT

     [ https://issues.apache.org/jira/browse/SYSTEMML-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Matthias Boehm resolved SYSTEMML-1838.
--------------------------------------
       Resolution: Fixed
         Assignee: Matthias Boehm
    Fix Version/s: SystemML 1.0

> Performance issues sparse/ultra-sparse binary read
> --------------------------------------------------
>
>                 Key: SYSTEMML-1838
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-1838
>             Project: SystemML
>          Issue Type: Bug
>            Reporter: Matthias Boehm
>            Assignee: Matthias Boehm
>             Fix For: SystemML 1.0
>
>
> Recent experiments with PageRank (20 iterations) on a 1M x 1M, sp=0.001 input showed
that the actual iterations are indeed very fast, at peak memory bandwidth (i.e., ~500ms per
iteration in CP only) but the initial read is unnecessarily slow, and thus dominating the
entire execution time. For example, in this scenario, the read took 41s. 
> This task aims to improve the read performance of sparse and ultra-sparse matrices into
CP.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message