hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Owen O'Malley <o...@yahoo-inc.com>
Subject Re: Reducer and Keys
Date Mon, 02 Oct 2006 06:37:59 GMT

On Sep 30, 2006, at 3:00 PM, Albert Chern wrote:

> I have noticed that the Reducer does not enforce that the key is kept
> unaltered after the reduce operation.  What would happen if output
> with a different key was collected?  I realize that the output would
> no longer be sorted, but would it cause the job to fail?

I believe it will work fine. The collector that is passed to the  
reduce is just a wrapper around the SequenceFile.Writer.  
SequenceFile.Writer is more than willing to write unsorted files.

-- Owen

View raw message