hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abhishek Shivkumar <abhisheksgum...@gmail.com>
Subject Re: how to skip a mapper
Date Mon, 10 Sep 2012 11:37:27 GMT
When the input to the mapper is a key,value pair, the key is the byte
offset of the file contents.
So, may be we can check if the file byte offset meets your criterion to do
the mapper task or not.

Thank you!

With Regards,
Abhishek S


On Mon, Sep 10, 2012 at 5:04 PM, Michael Segel <michael_segel@hotmail.com>wrote:

> Maybe.
> It depends on what you're trying to do.
>
> On Sep 10, 2012, at 6:31 AM, Anit Alexander <anitamalex@gmail.com> wrote:
>
> > Hello list,
> >
> >      Is it possible to start the mapper from a particular byte
> > location in a file which is in hdfs?
> >
> > Regards,
> > Anit
> >
>
>

Mime
View raw message