hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gang Luo <lgpub...@yahoo.com.cn>
Subject Re: reuse cached files
Date Mon, 02 Aug 2010 13:27:57 GMT
I am actually doing some test to see the performance. I want to eliminate the 
interference of distributed cache. I find there is method in the api to purge 
the cache. That might be what I want.

Thanks,
-Gang



----- 原始邮件 ----
发件人: Hemanth Yamijala <yhemanth@gmail.com>
收件人: common-user@hadoop.apache.org
发送日期: 2010/8/2 (周一) 12:56:25 上午
主   题: Re: reuse cached files

Hi,

> Thanks Hemanth. Is there any way to invalidate the reuse and ask Hadoop to
> resent exactly the same files to cache for every job?

I may be able to answer this better if I understand the use case. If
you need the same files for every job, why would you need to send them
afresh each time ? If something is cached, it can be reused, no ? I am
sure I must be missing something in your requirement ...

Thanks
Hemanth



      

Mime
View raw message