hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Subru Krishnan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5531) UnmanagedAM pool manager for federating application across clusters
Date Thu, 25 May 2017 00:06:04 GMT

    [ https://issues.apache.org/jira/browse/YARN-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16023920#comment-16023920
] 

Subru Krishnan commented on YARN-5531:
--------------------------------------

Thanks [~kasha] for your thoughtful comments. I walked through them in detail with [~botong]
based on v12 patch. I feel he has addressed most of the possible ones excepts for:
   * Add Visibility and Stability annotations for the pool class.
   * Have a helper method in {{UnmanagedAMPoolManager}} that doesn't require the user to provide
*uamId*. It'll will implicitly use the attempt id.
   * Move super. methods right at the end of serviceStart and serviceStop.
   * TODO for making shutdown non-blocking.
   * Javadocs to explain why UnmanagedAMIdentifier is public.
   * Consider moving rmProxy.finishApplicationMaster to be in a loop.
   * Change LOG levels in allocateAsync.
   * Nit: I prefer AMRequestHandlerThread.

> UnmanagedAM pool manager for federating application across clusters
> -------------------------------------------------------------------
>
>                 Key: YARN-5531
>                 URL: https://issues.apache.org/jira/browse/YARN-5531
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: nodemanager, resourcemanager
>            Reporter: Subru Krishnan
>            Assignee: Botong Huang
>         Attachments: YARN-5531-YARN-2915.v10.patch, YARN-5531-YARN-2915.v11.patch, YARN-5531-YARN-2915.v12.patch,
YARN-5531-YARN-2915.v1.patch, YARN-5531-YARN-2915.v2.patch, YARN-5531-YARN-2915.v3.patch,
YARN-5531-YARN-2915.v4.patch, YARN-5531-YARN-2915.v5.patch, YARN-5531-YARN-2915.v6.patch,
YARN-5531-YARN-2915.v7.patch, YARN-5531-YARN-2915.v8.patch, YARN-5531-YARN-2915.v9.patch
>
>
> One of the main tenets the YARN Federation is to *transparently* scale applications across
multiple clusters. This is achieved by running UAMs on behalf of the application on other
clusters. This JIRA tracks the addition of a UnmanagedAM pool manager for federating application
across clusters which will be used the FederationInterceptor (YARN-3666) which is part of
the AMRMProxy pipeline introduced in YARN-2884.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message