systemml-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias Boehm (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SYSTEMML-2400) Dynamic recompilation loses max thread constraints of hops
Date Sat, 16 Jun 2018 01:43:00 GMT

     [ https://issues.apache.org/jira/browse/SYSTEMML-2400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Matthias Boehm updated SYSTEMML-2400:
-------------------------------------
    Description: Dynamic recompilation deep copies the hop DAG and applies - among other things
- various rewrites. In case these rewrites create new hops (no inplace modification) these
rewrites lose the max thread constraints set by parfor and paramserv. On nodes with large
degree of parallelism this constitutes a serious issue because it leads to large over-provisioning
and thus reduced performance and potential OOMs.

> Dynamic recompilation loses max thread constraints of hops
> ----------------------------------------------------------
>
>                 Key: SYSTEMML-2400
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-2400
>             Project: SystemML
>          Issue Type: Bug
>            Reporter: Matthias Boehm
>            Priority: Major
>
> Dynamic recompilation deep copies the hop DAG and applies - among other things - various
rewrites. In case these rewrites create new hops (no inplace modification) these rewrites
lose the max thread constraints set by parfor and paramserv. On nodes with large degree of
parallelism this constitutes a serious issue because it leads to large over-provisioning and
thus reduced performance and potential OOMs.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message