hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Giovanni Matteo Fumarola (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-7010) Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps)
Date Wed, 23 Aug 2017 21:38:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139177#comment-16139177

Giovanni Matteo Fumarola commented on YARN-7010:

Thanks [~curino] for the feedback. Pushed v1.
2. Fixed.
3. I use CachedThreadPool. The size is not fixed, it creates new threads as needed, but will
reuse previously constructed threads when they are available with LRU Cache system.This webiste
explain the difference between them: [Executors.newCachedThreadPool() versus Executors.newFixedThreadPool()
| https://stackoverflow.com/questions/949355/executors-newcachedthreadpool-versus-executors-newfixedthreadpool]
4. Fixed.

For 1. the fixed is not trivial. My current solution has the following behavior:
If one subcluster is down, I merge the reports I have by discarding the UAMs without an AM.
To discriminate the UAM from the Federated ones I use size and name of the applications.

If the size is greater than 1 it means the AM spread in more than 1 subcluster -> Discarded.
If the size is 1 - it could be an UAM or an UAM depending from AMRMProxy - If the name starts
with the same convention we create the UAM inside AMRMProxy -> Discarded. 

> Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps)
> -------------------------------------------------------------------------------------
>                 Key: YARN-7010
>                 URL: https://issues.apache.org/jira/browse/YARN-7010
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Giovanni Matteo Fumarola
>            Assignee: Giovanni Matteo Fumarola
>         Attachments: YARN-7010.v0.patch, YARN-7010.v1.patch

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message