hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Farhan Husain <russ...@gmail.com>
Subject Re: File name to which mapper's key,value belongs to - is it available?
Date Sat, 25 Apr 2009 19:06:42 GMT
For this purpose, I have written my own InputFormat class but I believe
there is a better way of doing that. JobCong may provide information of
input file.

On Sat, Apr 25, 2009 at 12:19 PM, Saptarshi Guha
<saptarshi.guha@gmail.com>wrote:

> Hello,
> Is there a conf variable for getting the filename to which the current
> mapper's key,value belongs to?
> I have dir/dirA/part-X and dir/dirB/part-X
> i will process dir, but need to know whether the key,value is from
> dirA/part-* file or from a dirB/part-* file.
>
> I'd much rather not implement my own inputformat, since I'd like the
> method to be inputformat agnostic.
>
> Much thanks
> Saptarshi Guha
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message