hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: MultipleOutputs Files remain in temporary folder
Date Mon, 30 May 2011 19:50:57 GMT

I've not seen this happen yet. I've regularly used MO to write my
files and both TextFileO/F and NullO/F have worked fine despite me not
writing a byte to their collectors. In fact, the test case for MO too
passes when I modify it to never emit to the default output sink.

Are you using the default OutputCommitter (FileOutputCommitter)?

2011/5/30 Panayotis Antonopoulos <antonopoulospan@hotmail.com>:
> Hello,
> I just noticed that the files that are created using MultipleOutputs remain
> in the temporary folder into attempt sub-folders when there is no normal
> outputĀ  (using context.write(...)).
> Has anyone else noticed that?
> Is there any way to change that and make the files appear in the output
> directory?
> Thank you in advance!
> Panagiotis.

Harsh J

View raw message