hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun Suresh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node
Date Thu, 02 Jun 2016 16:43:59 GMT

    [ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15312630#comment-15312630

Arun Suresh commented on YARN-5171:

[~elgoiri], I don't think you are decrementing {{attemptResourceUsageOpportunistic}} when
the OPPORTUNISTIC container completes.
I guess we would should also have to remove it from the SchedulerApplicationAttempts's liveContainers
list. You can do this in the {{completedContainer()}} method in your if check like so:

   if (!rmContainer.isExternallyAllocated()) {
      completedContainerInternal(rmContainer, containerStatus, event);
    } else {
      // get the SchedulerApplicationAttempt
      // remove from the appAttempts liveContainers
      // decrement the appAttempts attemptResourceUsageOpportunistic

Makes sense ?

> Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node
> ------------------------------------------------------------------------------------
>                 Key: YARN-5171
>                 URL: https://issues.apache.org/jira/browse/YARN-5171
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Arun Suresh
>            Assignee: Inigo Goiri
>         Attachments: YARN-5171.000.patch, YARN-5171.001.patch, YARN-5171.002.patch, YARN-5171.003.patch
> Currently, the RM does not know about Containers allocated by the OpportunisticContainerAllocator
on the NM. This JIRA proposes to extend the Distributed Scheduler request interceptor and
the protocol to notify the RM of new containers as and when they are allocated at the NM.
The {{RMContainer}} should also be extended to expose the {{ExecutionType}} of the container.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message