systemml-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias Boehm (JIRA)" <>
Subject [jira] [Resolved] (SYSTEMML-1292) Support spark codegen instructions w/ multiple RDD inputs
Date Tue, 15 Aug 2017 20:06:02 GMT


Matthias Boehm resolved SYSTEMML-1292.
    Resolution: Done
      Assignee: Matthias Boehm

> Support spark codegen instructions w/ multiple RDD inputs
> ---------------------------------------------------------
>                 Key: SYSTEMML-1292
>                 URL:
>             Project: SystemML
>          Issue Type: Sub-task
>          Components: Compiler, Runtime
>            Reporter: Matthias Boehm
>            Assignee: Matthias Boehm
>             Fix For: SystemML 1.0
> This task aims to support spark codegen instructions (for all templates) over multiple
RDD inputs if not all side inputs fit into the local and remote broadcast memory budgets.
In detail, this might entail either (1) generating custom RDD operations and functions for
various combinations of input RDDs, or (2) a generalization of the related spark instructions
regarding the input RDD construction and a generic function signature.

This message was sent by Atlassian JIRA

View raw message