systemml-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "LI Guobao (JIRA)" <>
Subject [jira] [Commented] (SYSTEMML-2419) Setup and cleanup of remote workers
Date Fri, 13 Jul 2018 10:14:00 GMT


LI Guobao commented on SYSTEMML-2419:

[~mboehm7], I have some questions. The first is about the setup of remote parfor worker.
In fact, I saw that this block of code is synchronized and so I wonder if it means that in
one executor, the parfor task will be launched in multi-threaded way? The second is, what is
the codegen class used for? Because when parsing the parfor body, it will generate a codegen
class map.

> Setup and cleanup of remote workers
> -----------------------------------
>                 Key: SYSTEMML-2419
>                 URL:
>             Project: SystemML
>          Issue Type: Sub-task
>            Reporter: LI Guobao
>            Assignee: LI Guobao
>            Priority: Major
> In the context of distributed spark env, we need to firstly ship the necessary functions
and variables to the remote workers and then to initialize and register the cleanup of buffer
pool for each remote worker. All these are inspired by the parfor implementation.

This message was sent by Atlassian JIRA

View raw message