hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mohammad Tariq <donta...@gmail.com>
Subject Re: How does mapper process partial records?
Date Thu, 24 Jan 2013 17:13:37 GMT
Hello Praveen,

       Do you mean the InputFormat splits the file across record boundaries??I
actually didn't get your question. What do you mean by 'record' with
respect to HDFS. Did you mean HDFS block?

Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com


On Thu, Jan 24, 2013 at 10:20 PM, Praveen Sripati
<praveensripati@gmail.com>wrote:

> Hi,
>
> HDFS splits the file across record boundaries. So, how does the mapper
> processing the second block (b2) determine that the first record is
> incomplete and should process starting from the second record in the block
> (b2)?
>
> Thanks,
> Praveen
>

Mime
View raw message