hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Abhishek Modi (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-9608) DecommissioningNodesWatcher should get lists of running applications on node from RMNode.
Date Mon, 08 Jul 2019 07:28:00 GMT

     [ https://issues.apache.org/jira/browse/YARN-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Abhishek Modi updated YARN-9608:
--------------------------------
    Attachment: YARN-9608-branch-3.001.patch

> DecommissioningNodesWatcher should get lists of running applications on node from RMNode.
> -----------------------------------------------------------------------------------------
>
>                 Key: YARN-9608
>                 URL: https://issues.apache.org/jira/browse/YARN-9608
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Abhishek Modi
>            Assignee: Abhishek Modi
>            Priority: Major
>             Fix For: 3.3.0
>
>         Attachments: YARN-9608-branch-3.001.patch, YARN-9608.001.patch, YARN-9608.002.patch
>
>
> At present, DecommissioningNodesWatcher tracks list of running applications and triggers
decommission of nodes when all the applications that ran on the node completes. This Jira
proposes to solve following problem:
>  # DecommissioningNodesWatcher skips tracking application containers on a particular
node before the node is in DECOMMISSIONING state. It only tracks containers once the node
is in DECOMMISSIONING state. This can lead to shuffle data loss of apps whose containers ran
on this node before it was moved to decommissioning state.
>  # It is keeping track of running apps. We can leverage this directly from RMNode.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message