Return-Path: Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: (qmail 66061 invoked from network); 2 Jul 2010 01:53:44 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 2 Jul 2010 01:53:44 -0000 Received: (qmail 70236 invoked by uid 500); 2 Jul 2010 01:53:41 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 70078 invoked by uid 500); 2 Jul 2010 01:53:41 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 70070 invoked by uid 99); 2 Jul 2010 01:53:40 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 02 Jul 2010 01:53:40 +0000 X-ASF-Spam-Status: No, hits=2.5 required=10.0 tests=FREEMAIL_FROM,FREEMAIL_REPLY,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of yhemanth@gmail.com designates 74.125.83.176 as permitted sender) Received: from [74.125.83.176] (HELO mail-pv0-f176.google.com) (74.125.83.176) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 02 Jul 2010 01:53:34 +0000 Received: by pva4 with SMTP id 4so2214550pva.35 for ; Thu, 01 Jul 2010 18:52:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=W15XkHiNTbR8SuXCkphmOyMOkHCqSGj8OlhKXaVQZzA=; b=uKh3T7DAHsUm0v+8Y4wAejErQ/GmRkmY8NxRbZGQEZmLCgXXwY9cOtzu6bpS5W/ssS fWkBtM6AJe9pGZtJlFTfWGjNSHWHAYyEUNnZVWiUSvmmweYm6pglOxkrTcyjtRvTHDe+ 1GW7CDzXrU13IYiATe2RUJZ5g6vYFghWIp3L8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=EDELxWrjuXUXOZxcBhxI+ObWlWs/XBdfMVPDYZkh5lNaiSC+LONlKLvmO/u5Pdwv4a 63bAMFoUBlPPDcmWt9Wl4r0Yu0yyENxMiKrcVjHY+hwj532Yf9+H1JMP4HTUF1c7DZuO ZI//WL5TiFEq8B4X7iLhv3lhP5UEnVner5k6c= MIME-Version: 1.0 Received: by 10.142.169.7 with SMTP id r7mr48940wfe.57.1278035533475; Thu, 01 Jul 2010 18:52:13 -0700 (PDT) Received: by 10.142.188.19 with HTTP; Thu, 1 Jul 2010 18:52:13 -0700 (PDT) In-Reply-To: References: Date: Fri, 2 Jul 2010 07:22:13 +0530 Message-ID: Subject: Re: Intermediate files generated. From: Hemanth Yamijala To: common-user@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Alex, > I don't think this is what I am looking for. Essential, I wish to run bot= h > mapper as well as reducer. But at the same time, i wish to make sure that > the temp files that are used between mappers and reducers are of my choic= e. > Here, the choice means that I can specify the files in HDFS that can be u= sed > as temp files. Could you explain why you want to do this ? > > thanks, > --PB. > > On Fri, Jul 2, 2010 at 12:14 AM, Alex Loddengaard wro= te: > >> You could use the HDFS API from within your mapper, and run with 0 >> reducers. >> >> Alex >> >> On Thu, Jul 1, 2010 at 3:07 PM, Pramy Bhats > >wrote: >> >> > Hi, >> > >> > I am using hadoop framework for writing MapReduce jobs. I want =A0to >> redirect >> > the output of Map into files of my choice and later use those files as >> > input >> > for Reduce phase. >> > >> > >> > Could you please suggest, how to proceed for it ? >> > >> > thanks, >> > --PB. >> > >> >