hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hemanth Yamijala <yhema...@thoughtworks.com>
Subject Re: Not committing output in map reduce
Date Thu, 10 Jan 2013 12:44:38 GMT
Is this the same as:
http://stackoverflow.com/questions/6137139/how-to-save-only-non-empty-reducers-output-in-hdfs?

i.e. LazyOutputFormat, etc. ?


On Thu, Jan 10, 2013 at 4:51 PM, Pratyush Chandra <
chandra.pratyush@gmail.com> wrote:

> Hi,
>
> I am using s3n as file system. I do not wish to create output folders and
> file if there is no output from RecordReader implementation. Currently it
> creates empty part* files and _SUCCESS. Is there a way to do so ?
>
> --
> Pratyush Chandra
>

Mime
View raw message