hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Segel <michael_se...@hotmail.com>
Subject Re: Benefits of Hadoop Distributed Cache
Date Tue, 07 May 2013 22:48:27 GMT
Not sure what you mean...

If you want to put up a small file to be used by each Task in your job (mapper or reducer)...
you could put it up on HDFS. 

Or if you're launching your job from an edge node, you could read in the small file and put
it in to the distributed cache.  
It really depends on what you are attempting to do, and the size of the small file. 

On May 7, 2013, at 2:24 PM, Saeed Shahrivari <saeed.shahrivari@gmail.com> wrote:

> Would you please tell me why we should use Distributed Cache instead of HDFS?
> Because HDFS seems more stable, easier to use, and less error-prone.
> Thanks in advance.

View raw message