hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From dvohra <dvohr...@yahoo.com>
Subject Re: How to get the intermediate mapper output file name
Date Tue, 04 Jun 2013 13:34:36 GMT


The  part-m-00000,part-m-00001 file names are Hadoop naming conventions. To 
use custom output file names use the MultipleOutputs class. 

http://hadoop.apache.org/docs/current/api/org/apache/hadoop/mapred/lib/MultipleOutputs.html


With MultipleOutputs the file name may be customized as

<namedOutput>_<multiName>-(m|r)-<part-number>


On Monday, June 3, 2013 2:34:54 AM UTC-7, samir das mohapatra wrote:
>
> Hi all,
>    How to get the mapper output filename  inside the  the mapper .
>
>   or
>  
> How to change the  mapper ouput file name.
>  Default it looks like part-m-00000,part-m-00001 etc.
>
> Regards,
> samir.
>

Mime
  • Unnamed multipart/mixed (inline, None, 0 bytes)
View raw message