hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Naama Kraus" <naamakr...@gmail.com>
Subject Re: Map intermediate files location
Date Mon, 14 Jul 2008 04:48:07 GMT
Thanks.
Do you use Jetty for the http requests ? Anything else ?

Naama

On Mon, Jul 14, 2008 at 2:04 AM, Owen O'Malley <oom@yahoo-inc.com> wrote:

>
> On Jul 12, 2008, at 10:51 PM, Naama Kraus wrote:
>
>  Hi,
>>
>> In Google's Map Reduce paper, they mention that map tasks' intermediate
>> files are written to local file system. Later on, they are fetched by
>> reduce
>> nodes using RPC calls. Is this also true for Hadoop ?
>>
>
> Yes, although we use http rather than rpc.
>
> -- Owen
>



-- 
oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo
00 oo 00 oo
"If you want your children to be intelligent, read them fairy tales. If you
want them to be more intelligent, read them more fairy tales." (Albert
Einstein)

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message