hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hardik Pandya <smarty.ju...@gmail.com>
Subject Re: LocalResource size/time limits
Date Sat, 04 Jan 2014 18:14:41 GMT
May be this would clarify some aspect of your questions


Resource Localization in YARN Deep
Dive<http://hortonworks.com/blog/resource-localization-in-yarn-deep-dive/>

The threshold for local files is dictated by the configuration property
*yarn.nodemanager.localizer.cache.target-size-mb* described below.
http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-common/yarn-default.xml

yarn.nodemanager.localizer.cache.target-size-mb10240Target size of
localizer cache in MB, per local directory.


On Sat, Jan 4, 2014 at 12:02 PM, John Lilley <john.lilley@redpoint.net>wrote:

>  Are there any limits on the total size of LocalResources that a YARN app
> requests?  Do the PUBLIC ones age out of cache over time?  Are there
> settable controls?
>
> Thanks
>
> John
>
>
>
>
>

Mime
View raw message