Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 60131 invoked from network); 13 Jul 2008 13:03:14 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 13 Jul 2008 13:03:14 -0000 Received: (qmail 81880 invoked by uid 500); 13 Jul 2008 13:03:09 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 81846 invoked by uid 500); 13 Jul 2008 13:03:09 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 81835 invoked by uid 99); 13 Jul 2008 13:03:09 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 13 Jul 2008 06:03:09 -0700 X-ASF-Spam-Status: No, hits=2.0 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of naamakraus@gmail.com designates 209.85.128.184 as permitted sender) Received: from [209.85.128.184] (HELO fk-out-0910.google.com) (209.85.128.184) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 13 Jul 2008 13:02:17 +0000 Received: by fk-out-0910.google.com with SMTP id 26so2238616fkx.13 for ; Sun, 13 Jul 2008 06:02:39 -0700 (PDT) Received: by 10.86.59.18 with SMTP id h18mr12414578fga.4.1215928277363; Sat, 12 Jul 2008 22:51:17 -0700 (PDT) Received: by 10.86.3.12 with HTTP; Sat, 12 Jul 2008 22:51:17 -0700 (PDT) Message-ID: <643aa4870807122251k153e9286id8fbfc424ab3d8d4@mail.gmail.com> Date: Sun, 13 Jul 2008 08:51:17 +0300 From: "Naama Kraus" To: hadoop-core Subject: Map intermediate files location MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_9325_27723307.1215928277358" X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_9325_27723307.1215928277358 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Hi, In Google's Map Reduce paper, they mention that map tasks' intermediate files are written to local file system. Later on, they are fetched by reduce nodes using RPC calls. Is this also true for Hadoop ? Thanks, Naama -- oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo "If you want your children to be intelligent, read them fairy tales. If you want them to be more intelligent, read them more fairy tales." (Albert Einstein) ------=_Part_9325_27723307.1215928277358--