hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sunil G (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-6909) The performance advantages of YARN-6679 are lost when resource types are used
Date Tue, 31 Oct 2017 13:31:00 GMT

     [ https://issues.apache.org/jira/browse/YARN-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Sunil G updated YARN-6909:
    Attachment: YARN-6909.002.patch

Yes [~templedf], you are correct. I just did some refactoring to improve performance to see
how much I can achieve by optimizing ResourcePBImpl itself. Even with those changes in v1,
performance of 5 resources were close 43.5k only (with base value of 41k in trunk).

With current v2 patch, its now reached to 48k. I ll do some more runs to see the difference
of performance between 2 resources and 5 resources.

> The performance advantages of YARN-6679 are lost when resource types are used
> -----------------------------------------------------------------------------
>                 Key: YARN-6909
>                 URL: https://issues.apache.org/jira/browse/YARN-6909
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: resourcemanager
>    Affects Versions: YARN-3926
>            Reporter: Daniel Templeton
>            Assignee: Sunil G
>            Priority: Critical
>         Attachments: YARN-6909.001.patch, YARN-6909.002.patch
> YARN-6679 added the {{SimpleResource}} as a lightweight replacement for {{ResourcePBImpl}}
when a protobuf isn't needed.  With resource types enabled and anything other than memory
and CPU defined, {{ResourcePBImpl}} will always be used.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message