hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantinos Karanasos (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node
Date Fri, 17 Jun 2016 20:24:05 GMT

    [ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15336866#comment-15336866
] 

Konstantinos Karanasos commented on YARN-5171:
----------------------------------------------

Thanks for the new patch, [~elgoiri].

I just had an offline discussion with [~asuresh], and we agreed that currently it is a bit
confusing that in the {{SchedulerApplicationAttempt}} we use the newly introduced methods
{{addRMContainer}} and {{removeRMContainer}}, only for handling externally allocated containers,
while the existing containers are added in/removed from the {{liveContainers}} in different
places in the code.
So, let's do the following:
Keep the two new methods, but refactor the code, so that everybody (i.e., the existing guranteed
containers too) is using these methods when adding/removing RMContainers.
Makes sense?

Also, let's keep the opportunisticUsage, as it will be needed in other patches too (e.g.,
YARN-5220).

> Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node
> ------------------------------------------------------------------------------------
>
>                 Key: YARN-5171
>                 URL: https://issues.apache.org/jira/browse/YARN-5171
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Arun Suresh
>            Assignee: Inigo Goiri
>         Attachments: YARN-5171.000.patch, YARN-5171.001.patch, YARN-5171.002.patch, YARN-5171.003.patch,
YARN-5171.004.patch, YARN-5171.005.patch, YARN-5171.006.patch
>
>
> Currently, the RM does not know about Containers allocated by the OpportunisticContainerAllocator
on the NM. This JIRA proposes to extend the Distributed Scheduler request interceptor and
the protocol to notify the RM of new containers as and when they are allocated at the NM.
The {{RMContainer}} should also be extended to expose the {{ExecutionType}} of the container.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message