systemml-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias Boehm (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SYSTEMML-2042) Large Dense Matrix Blocks >16GB
Date Sat, 09 Dec 2017 03:17:00 GMT

     [ https://issues.apache.org/jira/browse/SYSTEMML-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Matthias Boehm updated SYSTEMML-2042:
-------------------------------------
    Description: This epic aims to add support for large-dense matrix blocks. Due to linearized
double arrays and Java's limitation of 2G array elements, the current dense block representation
is limited to 16GB. Given the trends towards large memory and scale-up environments, there
is a needs to overcome this limitation. In order to avoid the memory inefficiency of two-dimensional
(nested) arrays or chunked storage, we aim to provide alternative implementations that are
selected based on the dimensions of allocated matrix blocks. 

> Large Dense Matrix Blocks >16GB
> -------------------------------
>
>                 Key: SYSTEMML-2042
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-2042
>             Project: SystemML
>          Issue Type: Epic
>            Reporter: Matthias Boehm
>             Fix For: SystemML 1.1
>
>
> This epic aims to add support for large-dense matrix blocks. Due to linearized double
arrays and Java's limitation of 2G array elements, the current dense block representation
is limited to 16GB. Given the trends towards large memory and scale-up environments, there
is a needs to overcome this limitation. In order to avoid the memory inefficiency of two-dimensional
(nested) arrays or chunked storage, we aim to provide alternative implementations that are
selected based on the dimensions of allocated matrix blocks. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message