hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Amareshwari Sri Ramadasu <amar...@yahoo-inc.com>
Subject Re: Is it possible to write each key-value pair emitted by the reducer to a different output file
Date Fri, 05 Feb 2010 05:19:53 GMT
See MultipleOutputs at http://hadoop.apache.org/common/docs/r0.20.0/api/org/apache/hadoop/mapred/lib/MultipleOutputs.html

-Amareshwari

On 2/5/10 10:41 AM, "Udaya Lakshmi" <udaya603@gmail.com> wrote:

Hi,
  I was wondering if it is possible to write each key-value pair produced by
the reduce function to a different file. How could I open a new file in the
reduce function of the reducer? I know its possible in configure function
but it will write all the output that reducer to that file.
Thanks,
Udaya.


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message