hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bikas Saha (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1503) Support making additional 'LocalResources' available to running containers
Date Fri, 13 Dec 2013 10:46:09 GMT

    [ https://issues.apache.org/jira/browse/YARN-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13847380#comment-13847380
] 

Bikas Saha commented on YARN-1503:
----------------------------------

+1.
If multiple containers are already running on a node and we issue the same set of new resources
to be localized for all these containers, then will the NM make sure that there is only 1
concurrent download? Will this be a blocking call or is the second API meant to be used as
a polling mechanism?

> Support making additional 'LocalResources' available to running containers
> --------------------------------------------------------------------------
>
>                 Key: YARN-1503
>                 URL: https://issues.apache.org/jira/browse/YARN-1503
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Siddharth Seth
>            Assignee: Siddharth Seth
>
> We have a use case, where additional resources (jars, libraries etc) need to be made
available to an already running container. Ideally, we'd like this to be done via YARN (instead
of having potentially multiple containers per node download resources on their own).
> Proposal:
>   NM to support an additional API where a list of resources can be specified. Something
like "localiceResource(ContainerId, Map<String, LocalResource>)
>   NM would also require an additional API to get state for these resources - "getLocalizationState(ContainerId)"
- which returns the current state of all local resources for the specified container(s).



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)

Mime
View raw message