hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sangjin Lee (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-4761) NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler
Date Fri, 04 Mar 2016 07:10:40 GMT

     [ https://issues.apache.org/jira/browse/YARN-4761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sangjin Lee updated YARN-4761:
------------------------------
    Attachment: YARN-4761.02.patch

Thanks for the pointer [~rohithsharma]. It's good to know.

Posted patch v.2. I moved the unit test from {{TestCapacityScheduler}} to {{TestAbstractYarnScheduler}}.
I can confirm that the test fails before the fair scheduler changes and passes after.

> NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations
on fair scheduler
> ------------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-4761
>                 URL: https://issues.apache.org/jira/browse/YARN-4761
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: fairscheduler
>    Affects Versions: 2.6.4
>            Reporter: Sangjin Lee
>            Assignee: Sangjin Lee
>         Attachments: YARN-4761.01.patch, YARN-4761.02.patch
>
>
> YARN-3802 uncovered an issue with the scheduler where the resource calculation can be
incorrect due to async event handling. It was subsequently fixed by YARN-4344, but it was
never fixed for the fair scheduler.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message