hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Use different process method to process data by input file name?
Date Thu, 05 May 2011 09:56:58 GMT
Moving this to mapreduce--user@ since that is more appropriate for
hadoop-mapreduce questions (bcc: common-user@).

2011/5/5 王志强 <wangzhiqiang@360.cn>:
> Hi, guys
>      As the topic shows, how can I use different process methods to process data according
to input file name in map function? Ie, May I get the input file name that current process
line belong to?
>                                              Austin
>

You can get the filename using these additional JVM properties of the
MapTasks: http://hadoop.apache.org/common/docs/r0.20.2/mapred_tutorial.html#Task+JVM+Reuse
[Look at the table right below the link anchor for all properties, and
map.input.file in particular]

-- 
Harsh J

Mime
View raw message