hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wangda Tan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-7079) to support nodemanager ports management
Date Thu, 24 Aug 2017 19:02:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-7079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16140521#comment-16140521

Wangda Tan commented on YARN-7079:


Thanks for working on this feature. 

I took a very quick scan of uploaded patch. Some questions/comments:
1) As Devaraj said, it's always helpful to have design doc before working on such a big patch.
2) I found most of the code changes are adding new resource type (range) to the resource object,
which should be based on YARN-3926 for better maintenance. I haven't clearly considered how
to support value range in the new ResourceInformation object yet, more discussions needed
3) Beyond management allocated/available ports in RM, I think we need enforce in NM as well,
correct? Otherwise an app can request port \[1000-1008\], and once it is launched, it could
use more ports than requested.
4) Is it possible that this feature can be replaced by container + special network settings
which we can allocate different IPs to different containers. With that we don't need to worry
about the port management problem at all.

>  to support nodemanager  ports management
> -----------------------------------------
>                 Key: YARN-7079
>                 URL: https://issues.apache.org/jira/browse/YARN-7079
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: 田娟娟
>         Attachments: YARN_7079.001.patch
> Just like the vcores and memory, ports is also  important resource information to job
allocation . So we add the ports management logic to yarn. It can meet the user jobs' ports
 request, and  never allocate two jobs(with same port requirement) to one machine.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message