hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <tdunn...@maprtech.com>
Subject Re: HDFS - MapReduce coupling
Date Mon, 02 May 2011 06:56:59 GMT
Yes.  There is quite a bit of need for the local file system in clustered

For one think, all of the shuffle intermediate files are on local disk.  For
another, the distributed cache is actually stored on local disk.

HFDS is a frail vessel that cannot cope with all the needs.

On Sun, May 1, 2011 at 11:48 PM, Matthew John <tmatthewjohn1988@gmail.com>wrote:

> ...
> 2) Does the Hadoop system utilize the local storage directly for any
> purpose
> (without going through the HDFS) in clustered mode?

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message