systemml-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "LI Guobao (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SYSTEMML-2396) Batch pre-fetching per workers
Date Thu, 14 Jun 2018 22:04:00 GMT

     [ https://issues.apache.org/jira/browse/SYSTEMML-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

LI Guobao updated SYSTEMML-2396:
--------------------------------
    Description: This task aims to improve the performance of workers. Currently, in each
iteration of mini-batch, we need to slice the matrix, execute the gradients computation and
then send them to the ps for updating the model. While the ps is doing the aggregation work,
the worker pauses due to waiting for the new model. Hence the idea is to completely use this
free slot to pre-fetch the mini-batch in order to accelerate the future iteration.

> Batch pre-fetching per workers
> ------------------------------
>
>                 Key: SYSTEMML-2396
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-2396
>             Project: SystemML
>          Issue Type: Sub-task
>            Reporter: LI Guobao
>            Assignee: LI Guobao
>            Priority: Major
>
> This task aims to improve the performance of workers. Currently, in each iteration of
mini-batch, we need to slice the matrix, execute the gradients computation and then send them
to the ps for updating the model. While the ps is doing the aggregation work, the worker pauses
due to waiting for the new model. Hence the idea is to completely use this free slot to pre-fetch
the mini-batch in order to accelerate the future iteration.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message