systemml-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias Boehm (JIRA)" <j...@apache.org>
Subject [jira] [Closed] (SYSTEMML-2182) Univariate stats over 10Kx1K w/ wrong optimizer choice
Date Mon, 12 Mar 2018 02:30:00 GMT

     [ https://issues.apache.org/jira/browse/SYSTEMML-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Matthias Boehm closed SYSTEMML-2182.
------------------------------------
       Resolution: Fixed
         Assignee: Matthias Boehm
    Fix Version/s: SystemML 1.1

> Univariate stats over 10Kx1K w/ wrong optimizer choice
> ------------------------------------------------------
>
>                 Key: SYSTEMML-2182
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-2182
>             Project: SystemML
>          Issue Type: Sub-task
>            Reporter: Matthias Boehm
>            Assignee: Matthias Boehm
>            Priority: Major
>             Fix For: SystemML 1.1
>
>
> The parfor optimizer decided incorrectly on remote parfor for this very small input dataset.
> {code}
> Total elapsed time:		38.600 sec.
> Total compilation time:		1.978 sec.
> Total execution time:		36.622 sec.
> Number of compiled Spark inst:	1.
> Number of executed Spark inst:	1.
> Cache hits (Mem, WB, FS, HDFS):	4/0/0/426.
> Cache writes (WB, FS, HDFS):	2/0/2.
> Cache times (ACQr/m, RLS, EXP):	3.799/0.001/0.006/0.341 sec.
> HOP DAGs recompiled (PRED, SB):	0/0.
> HOP DAGs recompile time:	0.000 sec.
> Spark ctx create time (lazy):	21.545 sec.
> Spark trans counts (par,bc,col):0/0/0.
> Spark trans times (par,bc,col):	0.000/0.000/0.000 secs.
> ParFor loops optimized:		1.
> ParFor optimize time:		0.076 sec.
> ParFor initialize time:		0.000 sec.
> ParFor result merge time:	8.191 sec.
> ParFor total update in-place:	0/0/0
> Total JIT compile time:		26.803 sec.
> Total JVM GC count:		8.
> Total JVM GC time:		0.87 sec.
> Heavy hitter instructions:
>   #  Instruction  Time(s)  Count
>   1  ParFor-ESP    26.999      1
>   2  uacmax         0.762      1
>   3  >              0.184      1
>   4  write          0.102      1
>   5  rand           0.006      1
>   6  -              0.001      4
>   7  *              0.001      5
>   8  mvvar          0.000     23
>   9  uamax          0.000      1
>  10  rmvar          0.000      6
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message