hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Evans <ev...@yahoo-inc.com>
Subject Re: Problems adding JARs to distributed classpath in Hadoop 0.20.2
Date Thu, 26 May 2011 15:59:09 GMT
Vishnu,

You have to have a file system that is accessible from all nodes involved to run Hadoop Map
Reduce.  This could be NFS if it is a small number of nodes or even the local file system
if you are just running one node.  But, with that said  Hadoop is designed to process big
data GB, TB, and even PB, so HDFS or some other distributed File System is best if that is
what you are doing.  You can use it simply to distribute a computing job to several different
machines, but Hadoop Map Reduce still needs a file system as part of the distribution mechanism.

--Bobby Evans

On 5/26/11 10:46 AM, "vishnu krishnan" <vgrkrishnan@gmail.com> wrote:

am new in map reduce. one think i have to know. can i use the map reduce pgm without any file
system?


Mime
View raw message