Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of zhengda1936@gmail.com
 designates 209.85.216.169 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:user-agent:mime-version:to:subject:references
         :in-reply-to:content-type:content-transfer-encoding;
        b=GE1tjkw6YuVcT0H5fvy9st82nK3OzxoL0xxKY41CoE7W69kv5NsraPJdPtmcrkTzkr
         a16qQVrDbVdej2og1rS6Bl9SGYAC3uj67KF9zDFhCwrE52V87+wCmHu49yAd5+G2cmQr
         NcZDmZeYhY4X1XIdDebOlN53E+E7dMRDyCs0M=
Message-ID: <4D1C171D.5080202@gmail.com>
Date: Thu, 30 Dec 2010 00:22:37 -0500
From: Da Zheng <zhengda1936@gmail.com>
User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US;
 rv:1.9.2.13) Gecko/20101207 Thunderbird/3.1.7
MIME-Version: 1.0
To: common-user@hadoop.apache.org
Subject: Re: documentation of hadoop implementation
References: <4D1B7C03.7010701@gmail.com>
 <AANLkTin9SspYaaqzHEe0JigFFYAy_Sh=fYDuES2QYnFR@mail.gmail.com>
In-Reply-To: <AANLkTin9SspYaaqzHEe0JigFFYAy_Sh=fYDuES2QYnFR@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

Hi Todd,

It's exactly what I was looking for. Thanks.

Best,
Da

On 12/29/10 5:02 PM, Todd Lipcon wrote:
> Hi Da,
> 
> Chris Douglas had an excellent presentation at the Hadoop User Group last
> year on just this topic. Maybe you can find his slides or a recording on
> YDN/google?
> 
> -Todd
> 
> On Wed, Dec 29, 2010 at 10:20 AM, Da Zheng <zhengda1936@gmail.com> wrote:
> 
>> Hello,
>>
>> Is the implementation of Hadoop documented somewhere? especially that part
>> where
>> the output of mappers is partitioned, sorted and spilled to the disk. I
>> tried to
>> understand it, but it's rather complex. Is there any document that can help
>> me
>> understand it?
>>
>> Thanks,
>> Da
>>
> 
> 
>