systemml-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias Boehm (JIRA)" <>
Subject [jira] [Resolved] (SYSTEMML-1881) Tuning parfor degree of parallelism for operations
Date Sat, 02 Sep 2017 23:33:01 GMT


Matthias Boehm resolved SYSTEMML-1881.
       Resolution: Done
         Assignee: Matthias Boehm
    Fix Version/s: SystemML 1.0

> Tuning parfor degree of parallelism for operations
> --------------------------------------------------
>                 Key: SYSTEMML-1881
>                 URL:
>             Project: SystemML
>          Issue Type: Task
>            Reporter: Matthias Boehm
>            Assignee: Matthias Boehm
>             Fix For: SystemML 1.0
> Currently, we assign remaining parfor parallelism conservatively to operations of the
parfor body. Consider, for example, a Kmeans or MSVM scenario with 10 runs or 10 classes respectively.
On a box with 16 HW threads, we assign k=10 to the parfor and {{floor(16/10)}} to remaining
operations. Since it is usually a good idea to slightly over-provision CPU in order to get
full utilization (due to barriers at the end of each operation), we should tune this to {{round(16/10)}}
which provides performance improvements of about 15% in above examples. 

This message was sent by Atlassian JIRA

View raw message