hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From John Lilley <john.lil...@redpoint.net>
Subject RE: LocalResource size/time limits
Date Sun, 05 Jan 2014 21:23:30 GMT
Fantastic.  Just what I needed to know.
john

From: Hardik Pandya [mailto:smarty.juice@gmail.com]
Sent: Saturday, January 04, 2014 11:15 AM
To: user@hadoop.apache.org
Subject: Re: LocalResource size/time limits

May be this would clarify some aspect of your questions


Resource Localization in YARN Deep Dive<http://hortonworks.com/blog/resource-localization-in-yarn-deep-dive/>

The threshold for local files is dictated by the configuration property yarn.nodemanager.localizer.cache.target-size-mb
described below.
http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-common/yarn-default.xml

yarn.nodemanager.localizer.cache.target-size-mb

10240

Target size of localizer cache in MB, per local directory.


On Sat, Jan 4, 2014 at 12:02 PM, John Lilley <john.lilley@redpoint.net<mailto:john.lilley@redpoint.net>>
wrote:
Are there any limits on the total size of LocalResources that a YARN app requests?  Do the
PUBLIC ones age out of cache over time?  Are there settable controls?
Thanks
John




Mime
View raw message