hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ahmad Humayun" <ahmad.hu...@gmail.com>
Subject Re: MapTask intermediate data
Date Wed, 12 Mar 2008 13:10:49 GMT
Thanks Amar :)

On Wed, Mar 12, 2008 at 5:48 PM, Amar Kamat <amarrk@yahoo-inc.com> wrote:

> See HADOOP-2919. It explains the current technique. This will be a good
> starting point.
> Amar
> On Wed, 12 Mar 2008, Ahmad Humayun wrote:
>
> > Can somebody explain the process of the MapTask writing to the file the
> > intermediate output. The MapOutputBuffer.mergeParts() seems to be
> writing
> > different buffers into the same file. It seems like its also keeping an
> > index file.
> >
> > It will be great if somebody can guide me through the process.
> >
> >
> > regards,
> >
>



-- 
Ahmad Humayun
Research Assistant
Computer Science Dpt., LUMS
+92 321 4457315

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message