hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun Suresh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node
Date Thu, 02 Jun 2016 01:26:59 GMT

    [ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15311546#comment-15311546
] 

Arun Suresh commented on YARN-5171:
-----------------------------------

Actually... regarding the last part of my point #2 above... just realized, you would have
to ensure that if the container is allocated via Distributed Scheduling, control is not transferred
to the {{completedContainerInternal()}}, which is an abstract method, called from {{completedContainer()}}
method (else the specific scheduler will decrement the {{attemptResourceUsage}} as well as
the nodes and clusters resource usage). 
An {{ExecutionType == OPPORTUNISTIC}} check will not work, since YARN-1011 might need it to
go thru the scheduler.
So, I propose, adding a boolean in RMContainer, something like {{isExternallyAllocated}} which
can be used as a check before {{completedContainer()}} transfers control over to {{completedContainerInternal()}}
Hope this made sense...

> Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node
> ------------------------------------------------------------------------------------
>
>                 Key: YARN-5171
>                 URL: https://issues.apache.org/jira/browse/YARN-5171
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Arun Suresh
>            Assignee: Inigo Goiri
>         Attachments: YARN-5171.000.patch, YARN-5171.001.patch
>
>
> Currently, the RM does not know about Containers allocated by the OpportunisticContainerAllocator
on the NM. This JIRA proposes to extend the Distributed Scheduler request interceptor and
the protocol to notify the RM of new containers as and when they are allocated at the NM.
The {{RMContainer}} should also be extended to expose the {{ExecutionType}} of the container.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message