systemml-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias Boehm (JIRA)" <>
Subject [jira] [Created] (SYSTEMML-2175) Parfor spark fair scheduler pool leak
Date Thu, 08 Mar 2018 02:39:00 GMT
Matthias Boehm created SYSTEMML-2175:

             Summary: Parfor spark fair scheduler pool leak
                 Key: SYSTEMML-2175
             Project: SystemML
          Issue Type: Bug
            Reporter: Matthias Boehm

In an algorithm with an overall convergence loop and a parfor loop over large data in each
outer iteration, we encountered a leak of parfor fair scheduler pools. Specifically, this
issue seems to arise whenever the parfor loop has fewer iterations and thus workers than locally
available threads.

This message was sent by Atlassian JIRA

View raw message