hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wilfred Spiegelenburg (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-7139) FairScheduler: finished applications are always restored to default queue
Date Fri, 01 Sep 2017 06:00:01 GMT

     [ https://issues.apache.org/jira/browse/YARN-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Wilfred Spiegelenburg updated YARN-7139:
    Attachment: YARN-7139.02.patch

Some of the tests were failing due to sequencing of the RMApp creation and calling the scheduler.
These have been fixed by fixing the sequencing.

The left over tests that failed run without creating a RMApp and just test the handling of
the events. This means  that the RMApp can not be updated as is needed for the restore. I
added a check in the scheduler but it would be better to update all the tests to create an
RMApp and add it.

> FairScheduler: finished applications are always restored to default queue
> -------------------------------------------------------------------------
>                 Key: YARN-7139
>                 URL: https://issues.apache.org/jira/browse/YARN-7139
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: fairscheduler
>    Affects Versions: 2.8.1
>            Reporter: Wilfred Spiegelenburg
>            Assignee: Wilfred Spiegelenburg
>         Attachments: YARN-7139.01.patch, YARN-7139.02.patch
> The queue an application gets submitted to is defined by the placement policy in the
FS. The placement policy returns the queue and the application object is updated. When an
application is stored in the state store the application submission context is used which
has not been updated after the placement rules have run. 
> This means that the original queue from the submission is still stored which is the incorrect
queue. On restore we then read back the wrong queue and display the wrong queue in the RM
web UI.
> We should update the submission context after we have run the placement policies to make
sure that we store the correct queue for the application.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message