hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mohit Anchlia <mohitanch...@gmail.com>
Subject Re: WholeFileInputFormat in hadoop
Date Sun, 29 Jun 2014 18:54:36 GMT
I think it will be easier if you give your use case. You really would load the file if you
don't want it to split but there are many ways to solve the issue and that's why understanding
the use case is helpful.

Sent from my iPhone

> On Jun 29, 2014, at 9:28 AM, unmesha sreeveni <unmeshabiju@gmail.com> wrote:
> 
> But how is it different from normal execution and parallel MR.
> Although mapreduce is a parallel exec framework where the data into map is  a single
input.
> 
> If the Whole fileinput is jst an entire input split insead of the entire input file .
it will be useful right?
> if it is the whole file it can caught heapspace ..
> 
> Please correct me if I am wrong.
> 
> -- 
> Thanks & Regards
> 
> Unmesha Sreeveni U.B
> Hadoop, Bigdata Developer
> Center for Cyber Security | Amrita Vishwa Vidyapeetham
> http://www.unmeshasreeveni.blogspot.in/
> 
> 

Mime
View raw message