hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhongyue Nah (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-6720) Support updating FPGA related constraint node label after FPGA device re-configuration
Date Wed, 28 Jun 2017 12:19:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-6720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16066397#comment-16066397
] 

Zhongyue Nah commented on YARN-6720:
------------------------------------

[~leftnoteasy] YARN-3409 Wouldn't be a blocker since this JIRA is a improvement of YARN-6507.
We intend to move device metadata to global space so that the scheduler can make more efficient
decisions in terms of IP reuse. I assume GPGPUs have similar issues and we wish to find a
common solution across all resource types before we get this through.

> Support updating FPGA related constraint node label after FPGA device re-configuration
> --------------------------------------------------------------------------------------
>
>                 Key: YARN-6720
>                 URL: https://issues.apache.org/jira/browse/YARN-6720
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: yarn
>            Reporter: Zhankun Tang
>         Attachments: Storing-and-Updating-extra-FPGA-resource-attributes-in-hdfs_v1.pdf
>
>
> In order to provide a global optimal scheduling for mutable FPGA resource, it seems an
easy and direct way to utilize constraint node labels(YARN-3409) instead of extending the
global scheduler(YARN-3926) to match both resource count and attributes.
> The rough idea is that the AM sets the constraint node label expression to request containers
on the nodes whose FPGA devices has the matching IP, and then NM resource handler update the
node constraint label if there's FPGA device re-configuration.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message