hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: v0.20.203: How to stop creation of part-r-XXXXX files by reducer
Date Thu, 05 Apr 2012 06:41:53 GMT
Piyush,

This has been asked many times. You'll find your answer here:
http://search-hadoop.com/m/R4PzD1IoGjj2

On Thu, Apr 5, 2012 at 11:21 AM, Piyush Kansal <piyush.kansal@gmail.com> wrote:
> Hi Friends,
>
> In the reducer, I am dumping all the data to my customize set of files
> (using File I/O APIs) and thus not using the regular "context.write()". I am
> also creating filenames for these files at run time. This functionality is
> working fine.
>
> But, I am also getting "0 byte" part-r-XXXXX files in the o/p folder. I dont
> want these files since I am already creating my own set of files.
>
> So, can you please suggest how to turn off the creation of part-r-XXXXX
> files.
>
> --
> Regards,
> Piyush Kansal
>



-- 
Harsh J

Mime
View raw message