Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Tue, 28 Feb 2017 19:42:45 +0000 (UTC)
From: "Arun Suresh (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.13047070.1488309720000.22062.1488310965337@Atlassian.JIRA>
In-Reply-To: <JIRA.13047070.1488309720000@Atlassian.JIRA>
References: <JIRA.13047070.1488309720000@Atlassian.JIRA> <JIRA.13047070.1488309720909@jira-lw-us.apache.org>
Subject: [jira] [Updated] (YARN-6251) Fix Scheduler locking issue introduced
 by YARN-6216
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Tue, 28 Feb 2017 19:42:50 -0000


     [ https://issues.apache.org/jira/browse/YARN-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun Suresh updated YARN-6251:
------------------------------
    Attachment: YARN-6251.001.patch

Uploading fix.

The deadlock is due to the fact that the {{completeContainer()}} method (used to flush resources of temporary containers created during the update) is called in the AM's allocate thread, which tries to grab the lock on the queue and app... which can be contended for in the reverse order by the Scheduler thread on a NODE_UPDATE at the same time.

The proposed solution is: Instead of calling {{completeContainer()}} directly, we send it as an event to the Scheduler to handle.. This will ensure that the Scheduler is the only entity that will have the lock.   

> Fix Scheduler locking issue introduced by YARN-6216
> ---------------------------------------------------
>
>                 Key: YARN-6251
>                 URL: https://issues.apache.org/jira/browse/YARN-6251
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Arun Suresh
>            Assignee: Arun Suresh
>             Fix For: 3.0.0-alpha3
>
>         Attachments: YARN-6251.001.patch
>
>
> Opening to track a locking issue that was uncovered when running a custom SLS AMSimulator.


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org