hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun Suresh (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-2885) Create AMRMProxy request interceptor for distributed scheduling decisions for queueable containers
Date Mon, 18 Jan 2016 09:12:40 GMT

     [ https://issues.apache.org/jira/browse/YARN-2885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Arun Suresh updated YARN-2885:
------------------------------
    Attachment: YARN-2885-yarn-2877.v6.patch

Thanks for the comments [~kishorch] and [~giovanni.fumarola].

I have updated the patch based on your suggestions:
# Updated the {{RequestInterceptor}} to implement the {{DistributedSchedulingProtocol}} instead
of the {{ApplicationMasterProtocol}} : This essentially does not require any much change in
the implementing interceptors since 1) the former extends the latter and 2) the two extra
methods have a default implementation in the {{AbstractRequestInterceptor}}, so if it not
concerned with Distributed Scheduling, it will not have to deal with it.
# Updated the {{DefaultRequestInterceptor}} to talk to the RM using the {{DistributedSchedulingProtocol}}
instead of the {{ApplicationMasterProtocol}}.
# Removed {{LocalScheduler}} from the end of the chain.. and put back the DefaultRequestInterceptor

Do let me know what you think..

> Create AMRMProxy request interceptor for distributed scheduling decisions for queueable
containers
> --------------------------------------------------------------------------------------------------
>
>                 Key: YARN-2885
>                 URL: https://issues.apache.org/jira/browse/YARN-2885
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: nodemanager, resourcemanager
>            Reporter: Konstantinos Karanasos
>            Assignee: Arun Suresh
>         Attachments: YARN-2885-yarn-2877.001.patch, YARN-2885-yarn-2877.002.patch, YARN-2885-yarn-2877.full-2.patch,
YARN-2885-yarn-2877.full-3.patch, YARN-2885-yarn-2877.full.patch, YARN-2885-yarn-2877.v4.patch,
YARN-2885-yarn-2877.v5.patch, YARN-2885-yarn-2877.v6.patch, YARN-2885_api_changes.patch
>
>
> We propose to add a Local ResourceManager (LocalRM) to the NM in order to support distributed
scheduling decisions. 
> Architecturally we leverage the RMProxy, introduced in YARN-2884. 
> The LocalRM makes distributed decisions for queuable containers requests. 
> Guaranteed-start requests are still handled by the central RM.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message