systemml-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias Boehm (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SYSTEMML-1292) Support spark codegen instructions w/ multiple RDD inputs
Date Sat, 12 Aug 2017 05:01:00 GMT

     [ https://issues.apache.org/jira/browse/SYSTEMML-1292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Matthias Boehm updated SYSTEMML-1292:
-------------------------------------
    Summary: Support spark codegen instructions w/ multiple RDD inputs  (was: Generate n-ary
rdd operations)

> Support spark codegen instructions w/ multiple RDD inputs
> ---------------------------------------------------------
>
>                 Key: SYSTEMML-1292
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-1292
>             Project: SystemML
>          Issue Type: Sub-task
>          Components: Compiler, Runtime
>            Reporter: Matthias Boehm
>             Fix For: SystemML 1.0
>
>
> This task aims to support spark codegen instructions (for all templates) over multiple
RDD inputs if not all side inputs fit into the local and remote broadcast memory budgets.
In detail, this might entail either (1) generating custom RDD operations and functions for
various combinations of input RDDs, or (2) a generalization of the related spark instructions
regarding the input RDD construction and a generic function signature.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message