hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Carlo Curino (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent
Date Thu, 17 Dec 2015 06:09:46 GMT

    [ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15061563#comment-15061563
] 

Carlo Curino commented on YARN-4003:
------------------------------------

[~Sunil G], I think your understanding is correct. The point is that the AM percent limits
for a PlanQueue are mostly clashing with the highly dynamic nature of sub-queues being created/resized/destroyed
dynamically. In our experiments it was never useful, but sometimes it prevented jobs to start.
I don't think the proposed patch is perfect (for the reasons you pointed out), but at least
it allows jobs to go through. Do you have in mind any more principled way to set this?


> ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent
> --------------------------------------------------------------------------------------------
>
>                 Key: YARN-4003
>                 URL: https://issues.apache.org/jira/browse/YARN-4003
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: resourcemanager
>            Reporter: Carlo Curino
>            Assignee: Carlo Curino
>         Attachments: YARN-4003.patch
>
>
> The inherited behavior from LeafQueue (limit AM % based on capacity) is not a good fit
for ReservationQueue (that have highly dynamic capacity). 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message