systemml-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias Boehm (JIRA)" <>
Subject [jira] [Closed] (SYSTEMML-2234) Memory leak buffer pool due to missing variable cleanup
Date Fri, 06 Apr 2018 21:10:00 GMT


Matthias Boehm closed SYSTEMML-2234.
       Resolution: Fixed
         Assignee: Matthias Boehm
    Fix Version/s: SystemML 1.2

> Memory leak buffer pool due to missing variable cleanup
> -------------------------------------------------------
>                 Key: SYSTEMML-2234
>                 URL:
>             Project: SystemML
>          Issue Type: Task
>            Reporter: Matthias Boehm
>            Assignee: Matthias Boehm
>            Priority: Blocker
>             Fix For: SystemML 1.2
> There are scenarios where variables are not properly cleaned up before assigning new
matrices to logical variable names. This missing cleanup leads to a memory leak in the buffer
pool, which in turn leads to unnecessary evictions and missing cleanup of FS and HDFS files.
> After a closer investigation, this issue occurs for special cases of function calls that
have a peculiar control flow structure that prevents rmvar instructions for certain intermediates
and thus requires cleanup of these intermediates after the function call. Furthermore, a similar
issue occurs for loops with dedicated update-in place variables. 

This message was sent by Atlassian JIRA

View raw message