hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1016) Define a HDFS based repository that allows YARN services to share resources
Date Wed, 07 Aug 2013 19:25:48 GMT

    [ https://issues.apache.org/jira/browse/YARN-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13732610#comment-13732610

Jason Lowe commented on YARN-1016:

YARN already provides a cache of localized resources, both a per-user cache and a public one,
that uses timestamps of the requested resource to determine whether it has changed and attempts
to prune the cache to a targeted total cache size taking into account resources that are still
in use.  See ResourceLocalizationService and LocalResourcesTracker.

Is there something beyond this that you are requesting?
> Define a HDFS based repository that allows YARN services to share resources
> ---------------------------------------------------------------------------
>                 Key: YARN-1016
>                 URL: https://issues.apache.org/jira/browse/YARN-1016
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: api
>    Affects Versions: 3.0.0
>            Reporter: Kam Kasravi
> YARN services both short and long lived can benefit from a resource repo rather than
packaging resources within the YARN client to be extracted and used by the Application Master
and (later) the containers. Standardizing a resource repo will provide performance benefits
as well. The repo should be similar to maven or ivy repo's so discovery and versioning are

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message