hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arun C Murthy <...@yahoo-inc.com>
Subject Re: InputSplit is confusing me .. Any clarifications ??
Date Sun, 28 Nov 2010 05:27:05 GMT
Moving to mapreduce-user@, bcc common-user@. Please use project  
specific lists.

Your InputSplits are defined by your InputFormat. Take a look  
'getSplits' method in InputFormat.java.

http://hadoop.apache.org/common/docs/r0.20.0/mapred_tutorial.html#Job+Input
http://hadoop.apache.org/common/docs/r0.20.0/mapred_tutorial.html#InputSplit

Arun

On Nov 27, 2010, at 3:42 PM, maha wrote:

> Sorry I mistyped LineRecordReader by LineInputSplit ... So here is  
> my question again ..
>
>>
>> Thanks for the reply .. although I read it has to do with  
>> "InputSplit" which represents the data to be processed by an  
>> individual Mapper. By default it's a LineRecordReader.
>>
>> How can I change this property to be FileInputSpilt and Record is  
>> the whole File ?
>>
>> something like JobConf.set ("File.input.format","FileInptSplit");
>>
>> Is there such way?
>>
>> Thanks in advance,
>>  Maha
>>
>


Mime
View raw message