hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gang Luo <lgpub...@yahoo.com.cn>
Subject Re: TTL of distributed cache
Date Wed, 17 Mar 2010 05:13:56 GMT
It is smart. Thanks Amareshwari.


----- 原始邮件 ----
发件人: Amareshwari Sri Ramadasu <amarsri@yahoo-inc.com>
收件人: "common-user@hadoop.apache.org" <common-user@hadoop.apache.org>
发送日期: 2010/3/16 (周二) 11:08:31 下午
主   题: Re: TTL of distributed cache

Hi Gang,
Answers inline.

On 3/16/10 9:58 AM, "Gang Luo" <lgpublic@yahoo.com.cn> wrote:

Hi all,
what is the life length of the distributed cache files?
Localized cache file will be removed, if the file is not used by any job and localized disk
space on the machine goes higher than configured local.cache.size(by default, 10 GB).

Will hadoop redistributed the same file to the same node twice if it is being used by two
No, It will be localized only once. Both the jobs will use the same localized file. If the
file gets modified on DFS, then it will be localized once again.



View raw message