hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jian He (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-1503) Continuous resource-localization for YARN containers
Date Tue, 23 Aug 2016 12:49:21 GMT

     [ https://issues.apache.org/jira/browse/YARN-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jian He updated YARN-1503:
--------------------------
    Description: 
We have a use case, where additional resources (jars, libraries etc) need to be made available
to an already running container. Ideally, we'd like this to be done via YARN (instead of having
potentially multiple containers per node download resources on their own).

The goal is to enable NodeManagers to localize resources while container is running. Today,
resource-localization is always the first step before starting a container. It will be useful
if YARN can localize the resources continuously even while container is running.


  was:
We have a use case, where additional resources (jars, libraries etc) need to be made available
to an already running container. Ideally, we'd like this to be done via YARN (instead of having
potentially multiple containers per node download resources on their own).

Proposal:
  NM to support an additional API where a list of resources can be specified. Something like
"localiceResource(ContainerId, Map<String, LocalResource>)
  NM would also require an additional API to get state for these resources - "getLocalizationState(ContainerId)"
- which returns the current state of all local resources for the specified container(s).



> Continuous resource-localization for YARN containers
> ----------------------------------------------------
>
>                 Key: YARN-1503
>                 URL: https://issues.apache.org/jira/browse/YARN-1503
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Siddharth Seth
>            Assignee: Jian He
>         Attachments: Continuous-resource-localization.pdf
>
>
> We have a use case, where additional resources (jars, libraries etc) need to be made
available to an already running container. Ideally, we'd like this to be done via YARN (instead
of having potentially multiple containers per node download resources on their own).
> The goal is to enable NodeManagers to localize resources while container is running.
Today, resource-localization is always the first step before starting a container. It will
be useful if YARN can localize the resources continuously even while container is running.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message