Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 24233 invoked from network); 14 Mar 2008 11:37:58 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 14 Mar 2008 11:37:58 -0000 Received: (qmail 5780 invoked by uid 500); 14 Mar 2008 11:37:54 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 5769 invoked by uid 500); 14 Mar 2008 11:37:54 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 5758 invoked by uid 99); 14 Mar 2008 11:37:54 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Mar 2008 04:37:54 -0700 X-ASF-Spam-Status: No, hits=2.0 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ahmad.humyn@gmail.com designates 209.85.198.184 as permitted sender) Received: from [209.85.198.184] (HELO rv-out-0910.google.com) (209.85.198.184) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Mar 2008 11:37:17 +0000 Received: by rv-out-0910.google.com with SMTP id g11so3775251rvb.29 for ; Fri, 14 Mar 2008 04:37:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:mime-version:content-type; bh=B3k2IGxrbbWAxabcwK2MC5nmaepYdUobziPQQayrgmI=; b=Jjk/Y9aVp2v1gKZnRkk+8Ue1PPuizFyZuo6reXJRrz/mBvQArsrD0QzBZhyPG3HGTKb4g0jXJib1rGUqecPqzjcG5/xgnKcoCpJfCAK8XJhhentR0S6tPAXNhZnCKHb07+GxBtRjB+fwmTCDzmMpHJ1SUWJM/kaWmjNXhFVdTSA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type; b=m0d4YQLqahSqm/uyjQKlD0V2Ty4P2stQJ32LNQuI9ELWUZx3EX+C0UuTu859ORb/saVXeIpP8wYs8o94kJBN6JK5zpBG37lIQ66/eTDqTKE0VsXlc9kHIFvOSQOIBAUPOg0tcengntP4yN887C2WqsYrmd0oCnOrwwY0Z1k4C/M= Received: by 10.140.187.10 with SMTP id k10mr6382636rvf.86.1205494648080; Fri, 14 Mar 2008 04:37:28 -0700 (PDT) Received: by 10.140.177.3 with HTTP; Fri, 14 Mar 2008 04:37:28 -0700 (PDT) Message-ID: <96d3bba10803140437h2628f62bl325fea29bb9ae951@mail.gmail.com> Date: Fri, 14 Mar 2008 16:37:28 +0500 From: "Ahmad Humayun" To: core-dev@hadoop.apache.org Subject: FS to DFS MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_11463_15309082.1205494648084" X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_11463_15309082.1205494648084 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Hi there, Does the map input (for a certain node) on the DFS get copied to the local FS before work starts on it? Can you point me to a place in the code for this? Plus once the shuffle phase ends and the reduce task receives all the intermediate data from all the maps, does every reduce copies the intermediate data to the DFS for safe keeping? thanks for all the help :) regards, -- Ahmad Humayun Research Assistant Computer Science Dpt., LUMS +92 321 4457315 ------=_Part_11463_15309082.1205494648084--