Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of yaojingguo@gmail.com designates
 209.85.212.182 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAOcnVr270a-M0U294kS=P1ucY5BfRmssrOmJ0k_HuE-0B2NEeg@mail.gmail.com>
References: 
 <CANPB7a7rh2SSLEBEmNViMg9F1RWtR67FLd=RE25=hGFWkVwreQ@mail.gmail.com>
	<CAOcnVr270a-M0U294kS=P1ucY5BfRmssrOmJ0k_HuE-0B2NEeg@mail.gmail.com>
Date: Tue, 26 Mar 2013 17:45:14 +0800
Message-ID: 
 <CANPB7a7RU8j48Za7gkTxH=_JfsdXJT7Xa3fOwHTFVScovV8YDA@mail.gmail.com>
Subject: Re: Is the input values for reduce method sorted in any order?
From: jingguo yao <yaojingguo@gmail.com>
To: user@hadoop.apache.org
Content-Type: text/plain; charset=UTF-8

Harsh, thanks.

On Tue, Mar 26, 2013 at 2:28 PM, Harsh J <harsh@cloudera.com> wrote:
> MR will partition and sort inputs by keys by the key comparator, and
> then group them together when reading back via a grouping comparator
> (which is usually the same as the key comparator). It will not re-sort
> the values nor look at any of the value's fields during this process.
>
> If you want your values to be sorted, implementing secondary sort
> would need to happen wherein you extract the value-sort attributes
> onto your keys and have them grouped differently.
>
> On Tue, Mar 26, 2013 at 10:55 AM, jingguo yao <yaojingguo@gmail.com> wrote:
>> Is the Iterable values associated with a key sorted in any order?  Are
>> there are any configuration options controlling how the input values are
>> sorted?
>>
>> I know that the secondary sort way can be used to achieve the same
>> effect. I am not asking for a workaround.
>>
>> --
>> Jingguo
>
>
>
> --
> Harsh J


-- 
Jingguo