systemml-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias Boehm (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SYSTEMML-1741) Rework codegen cost-based plan selector (opt V2)
Date Fri, 30 Jun 2017 06:33:00 GMT

     [ https://issues.apache.org/jira/browse/SYSTEMML-1741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Matthias Boehm updated SYSTEMML-1741:
-------------------------------------
    Description: 
So far our the cost-based codegen plan selector considers all materialization points per connected
component of partial fusion plan candidates as well as multi aggregates and various cleanups
in independent steps. This aims to rework this into a full-fledged cost-based optimizer to
address poor plan choices encountered in various complex DAGs.

In detail, the new cost-based plan selector needs to address the following in an holistic
manner:
* Potential materialization points (operators with multiple consumers), decided on a per-consumer
basis
* Sparsity exploitation (in cost model and template flagging) incl ordering of inputs
* Decisions on (overlapping) template types
* Multi-aggregates for cell- and row-templates
* Constraints and costs for distributed operations (see SYSTEMML-1443)

  was:
So far our the cost-based codegen plan selector considers all materialization points per connected
component of partial fusion plan candidates as well as multi aggregates and various cleanups
in independent steps. This aims to rework this into a full-fledged cost-based optimizer to
address poor plan choices encountered in various complex DAGs.

In detail, the new cost-based plan selector needs to address the following in an holistic
manner:
* Potential materialization points (operators with multiple consumers), decided on a per-consumer
basis
* Sparsity exploitation (in cost model and template flagging) incl ordering of inputs
* Decisions on (overlapping) template types
* Multi-aggregates for cell- and row-templates
* Constraints and costs for distributed operations


> Rework codegen cost-based plan selector (opt V2)
> ------------------------------------------------
>
>                 Key: SYSTEMML-1741
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-1741
>             Project: SystemML
>          Issue Type: Sub-task
>          Components: Compiler, Runtime
>            Reporter: Matthias Boehm
>             Fix For: SystemML 0.14
>
>
> So far our the cost-based codegen plan selector considers all materialization points
per connected component of partial fusion plan candidates as well as multi aggregates and
various cleanups in independent steps. This aims to rework this into a full-fledged cost-based
optimizer to address poor plan choices encountered in various complex DAGs.
> In detail, the new cost-based plan selector needs to address the following in an holistic
manner:
> * Potential materialization points (operators with multiple consumers), decided on a
per-consumer basis
> * Sparsity exploitation (in cost model and template flagging) incl ordering of inputs
> * Decisions on (overlapping) template types
> * Multi-aggregates for cell- and row-templates
> * Constraints and costs for distributed operations (see SYSTEMML-1443)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message