hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Carlo Curino (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-4358) Improve relationship between SharingPolicy and ReservationAgent
Date Mon, 16 Nov 2015 23:58:10 GMT

    [ https://issues.apache.org/jira/browse/YARN-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007657#comment-15007657

Carlo Curino commented on YARN-4358:

In this patch, we propose to change the relationship between ReservationAgent/Plan/SharingPolicy
for two reasons:
 * agents ignore constraints that the SharingPolicy knows about (e.g., instantaneous max Resource)
 * agents repeatedly query the plan to obtain a view of resources (and remove the used from
the total available)

We introduce a new API in the plan, that provides a compact RLESparseResourceAllocation based
view of available resources.
Furhtermore, the InMemoryPlan interacts with the SharingPolicy to "customize" the view so
that the agent only sees the resources
that are available for the given tenant at the given time. 

> Improve relationship between SharingPolicy and ReservationAgent
> ---------------------------------------------------------------
>                 Key: YARN-4358
>                 URL: https://issues.apache.org/jira/browse/YARN-4358
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: capacityscheduler, fairscheduler, resourcemanager
>            Reporter: Carlo Curino
>            Assignee: Carlo Curino
> At the moment an agent places based on available resources, but has no visibility to
extra constraints imposed by the SharingPolicy. While not all constraints are easily represented
some (e.g., max-instantaneous resources) are easily represented.

This message was sent by Atlassian JIRA

View raw message