hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: MultipleOutputs side effects
Date Fri, 28 Sep 2012 12:03:55 GMT
Yes - for new API MultipleOutput, use LazyOutputFormat as job's output
format, and for old API, use the NullOutputFormat as the jobconf's
output format.

On Fri, Sep 28, 2012 at 5:14 PM, Hemanth Yamijala
<yhemanth@thoughtworks.com> wrote:
> This came up recently on the forums, IIRC. The answer was to use to
> something called LazyOutputFormat to suppress the output file ?
>
> I think this thread has the discussion:
>
> http://search-hadoop.com/m/66Thjsj97v1/hadoop+1.0.3+equivalent+of+MultipleTextOutputFormat&subj=RE+hadoop+1+0+3+equivalent+of+MultipleTextOutputFormat
>
> Thanks
> hemanth
>
>
> On Fri, Sep 28, 2012 at 5:07 PM, Frank Kootte <frankkootte@gmail.com> wrote:
>>
>> While using MultipleOutputs with CHD3 0.20.2+923.418-1 I get besides the
>> desired output files also a empty snappy file per reducer for free.
>> Anybody familiar with this symptom and perhaps knows how to fix it ?
>>
>> --
>> Mvrgr. Frank
>
>



-- 
Harsh J

Mime
View raw message