Return-Path: Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: (qmail 29079 invoked from network); 1 Jul 2010 23:08:33 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 1 Jul 2010 23:08:33 -0000 Received: (qmail 50634 invoked by uid 500); 1 Jul 2010 23:08:31 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 50583 invoked by uid 500); 1 Jul 2010 23:08:30 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 50574 invoked by uid 99); 1 Jul 2010 23:08:30 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Jul 2010 23:08:30 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=FREEMAIL_FROM,HTML_MESSAGE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of pramybhats@googlemail.com designates 74.125.82.42 as permitted sender) Received: from [74.125.82.42] (HELO mail-ww0-f42.google.com) (74.125.82.42) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Jul 2010 23:08:24 +0000 Received: by wwd20 with SMTP id 20so443526wwd.5 for ; Thu, 01 Jul 2010 16:08:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:content-type; bh=WgpEiL3H6g+ZmWct1NYgZ9kk/7IzKxNFL1Uqh+HbXCE=; b=ddEFpoU3zfDwGH9VbGNMMD75FP74ZkcHfiKFot08Fw45Th0/rwxa6yG7gHWzJ+5bbt x6wqr7yTQNbeGLuCMhs+Cca7VvmCRJT+oWE/jPoZ9Xrm/7AEFsGYVj6sQ8FwmE1YapWc 1rTRvnU+D7Zd88Jhw272d7BEXBC75MT4nhke4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=UFnxZGOa+Psh1V1PTEP9ScAPaRHrZQIpxxysQz0slyaomULFadc6axdQYj2yE3DfW+ xCWJ0/IeudTzXqPBJ5ozbKvONDpL0T5sjV5LAmOW0nT09A+VBM/hyZWntdX7Vy2mAHTJ zfAMMVcc8NIE87GIjXiiKYG+YuRUMT4EDjmH0= MIME-Version: 1.0 Received: by 10.227.138.132 with SMTP id a4mr103977wbu.172.1278025683881; Thu, 01 Jul 2010 16:08:03 -0700 (PDT) Received: by 10.227.146.130 with HTTP; Thu, 1 Jul 2010 16:08:03 -0700 (PDT) In-Reply-To: References: Date: Fri, 2 Jul 2010 01:08:03 +0200 Message-ID: Subject: Re: Intermediate files generated. From: Pramy Bhats To: common-user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001636832f18e6ce2c048a5b8a3f X-Virus-Checked: Checked by ClamAV on apache.org --001636832f18e6ce2c048a5b8a3f Content-Type: text/plain; charset=ISO-8859-1 Hi Alex, I don't think this is what I am looking for. Essential, I wish to run both mapper as well as reducer. But at the same time, i wish to make sure that the temp files that are used between mappers and reducers are of my choice. Here, the choice means that I can specify the files in HDFS that can be used as temp files. thanks, --PB. On Fri, Jul 2, 2010 at 12:14 AM, Alex Loddengaard wrote: > You could use the HDFS API from within your mapper, and run with 0 > reducers. > > Alex > > On Thu, Jul 1, 2010 at 3:07 PM, Pramy Bhats >wrote: > > > Hi, > > > > I am using hadoop framework for writing MapReduce jobs. I want to > redirect > > the output of Map into files of my choice and later use those files as > > input > > for Reduce phase. > > > > > > Could you please suggest, how to proceed for it ? > > > > thanks, > > --PB. > > > --001636832f18e6ce2c048a5b8a3f--