hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Josh Smith <jesmit...@gmail.com>
Subject MultipleOutputs and Custom Writers
Date Fri, 28 Feb 2014 16:17:11 GMT
I need to output 3 different XML files from my map reduce job. I currently
have it working for a single file, but when I try to add in the logic for
MultipleOutputs to the reducer to support splitting the files, I get errors
from the writer attempting to write to the same file.
I assume thats caused by trying to manage the output file name via the
custom FileOutputFormat class implementation.

Has anyone got a good example of combining MultipleOutputs and a custom
OutputFormat class that I can use?

To make matters worse I have to configure all of this via Oozie as thats
enforced by the commercial Hadoop appliance my company uses.

View raw message