systemml-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias Boehm (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SYSTEMML-1836) Large GC overhead for scripts w/ row-wise generated operators.
Date Mon, 16 Oct 2017 03:31:03 GMT

    [ https://issues.apache.org/jira/browse/SYSTEMML-1836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16205404#comment-16205404
] 

Matthias Boehm commented on SYSTEMML-1836:
------------------------------------------

Recent experiments with ALS and the fusion heuristic fuse-all have shown that there are still
remaining issues related to GC overhead in row-wise operators, specifically for large rows
and multi-threaded operations, which both significantly aggravate the problem.

> Large GC overhead for scripts w/ row-wise generated operators.
> --------------------------------------------------------------
>
>                 Key: SYSTEMML-1836
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-1836
>             Project: SystemML
>          Issue Type: Bug
>            Reporter: Matthias Boehm
>            Assignee: Matthias Boehm
>             Fix For: SystemML 0.15
>
>
> This task aims to improve the unnecessary large garbage collection overhead for scripts
with many row-wise fused operators. For example, Kmeans and Mlogreg over 10M x 10 inputs show
GC overheads of 102s and 37s, respectively.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message