hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1016) Define a HDFS based repository that allows YARN services to share resources
Date Wed, 07 Aug 2013 19:25:48 GMT

    [ https://issues.apache.org/jira/browse/YARN-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13732610#comment-13732610
] 

Jason Lowe commented on YARN-1016:
----------------------------------

YARN already provides a cache of localized resources, both a per-user cache and a public one,
that uses timestamps of the requested resource to determine whether it has changed and attempts
to prune the cache to a targeted total cache size taking into account resources that are still
in use.  See ResourceLocalizationService and LocalResourcesTracker.

Is there something beyond this that you are requesting?
                
> Define a HDFS based repository that allows YARN services to share resources
> ---------------------------------------------------------------------------
>
>                 Key: YARN-1016
>                 URL: https://issues.apache.org/jira/browse/YARN-1016
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: api
>    Affects Versions: 3.0.0
>            Reporter: Kam Kasravi
>
> YARN services both short and long lived can benefit from a resource repo rather than
packaging resources within the YARN client to be extracted and used by the Application Master
and (later) the containers. Standardizing a resource repo will provide performance benefits
as well. The repo should be similar to maven or ivy repo's so discovery and versioning are
built-in.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message