hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Agarwal, Nikhil" <Nikhil.Agar...@netapp.com>
Subject How is sharing done in HDFS ?
Date Wed, 22 May 2013 08:29:37 GMT

Can anyone guide me to some pointers or explain how HDFS shares the information put in the
temporary directories (hadoop.tmp.dir, mapred.tmp.dir, etc.) to all other nodes?

I suppose that during execution of a MapReduce job, the JobTracker prepares a file called
jobtoken and puts it in the temporary directories. which needs to be read by all TaskTrackers.
So, how does HDFS share the contents? Does it use nfs mount or ....?

Thanks & Regards,

View raw message