systemml-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias Boehm (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SYSTEMML-2175) Parfor spark fair scheduler pool leak
Date Thu, 08 Mar 2018 02:39:00 GMT
Matthias Boehm created SYSTEMML-2175:
----------------------------------------

             Summary: Parfor spark fair scheduler pool leak
                 Key: SYSTEMML-2175
                 URL: https://issues.apache.org/jira/browse/SYSTEMML-2175
             Project: SystemML
          Issue Type: Bug
            Reporter: Matthias Boehm


In an algorithm with an overall convergence loop and a parfor loop over large data in each
outer iteration, we encountered a leak of parfor fair scheduler pools. Specifically, this
issue seems to arise whenever the parfor loop has fewer iterations and thus workers than locally
available threads.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message