Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Tue, 23 Aug 2016 12:49:21 +0000 (UTC)
From: "Jian He (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.12684354.1386883259000.382880.1471956561833@Atlassian.JIRA>
In-Reply-To: <JIRA.12684354.1386883259000@Atlassian.JIRA>
References: <JIRA.12684354.1386883259000@Atlassian.JIRA> <JIRA.12684354.1386883259774@arcas>
Subject: [jira] [Updated] (YARN-1503) Continuous resource-localization for
 YARN containers
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Tue, 23 Aug 2016 12:49:27 -0000


     [ https://issues.apache.org/jira/browse/YARN-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jian He updated YARN-1503:
--------------------------
    Description: 
We have a use case, where additional resources (jars, libraries etc) need to be made available to an already running container. Ideally, we'd like this to be done via YARN (instead of having potentially multiple containers per node download resources on their own).

The goal is to enable NodeManagers to localize resources while container is running. Today, resource-localization is always the first step before starting a container. It will be useful if YARN can localize the resources continuously even while container is running.


  was:
We have a use case, where additional resources (jars, libraries etc) need to be made available to an already running container. Ideally, we'd like this to be done via YARN (instead of having potentially multiple containers per node download resources on their own).

Proposal:
  NM to support an additional API where a list of resources can be specified. Something like "localiceResource(ContainerId, Map<String, LocalResource>)
  NM would also require an additional API to get state for these resources - "getLocalizationState(ContainerId)" - which returns the current state of all local resources for the specified container(s).


> Continuous resource-localization for YARN containers
> ----------------------------------------------------
>
>                 Key: YARN-1503
>                 URL: https://issues.apache.org/jira/browse/YARN-1503
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Siddharth Seth
>            Assignee: Jian He
>         Attachments: Continuous-resource-localization.pdf
>
>
> We have a use case, where additional resources (jars, libraries etc) need to be made available to an already running container. Ideally, we'd like this to be done via YARN (instead of having potentially multiple containers per node download resources on their own).
> The goal is to enable NodeManagers to localize resources while container is running. Today, resource-localization is always the first step before starting a container. It will be useful if YARN can localize the resources continuously even while container is running.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org