Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of harsh@cloudera.com designates
 209.85.223.178 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAMe0HzRPB7EJwFtLw8RLEp1-1Yd6ZtKHgMBRvpLoT6r8zUpWZA@mail.gmail.com>
References: 
 <CAMe0HzRPB7EJwFtLw8RLEp1-1Yd6ZtKHgMBRvpLoT6r8zUpWZA@mail.gmail.com>
From: Harsh J <harsh@cloudera.com>
Date: Sun, 24 Mar 2013 19:14:11 +0530
Message-ID: 
 <CAOcnVr238199RUoMSy9ymXqGTfXAN6EGTM_RcL4cgmG8gx7BMQ@mail.gmail.com>
Subject: Re: 2 Reduce method in one Job
To: "<user@hadoop.apache.org>" <user@hadoop.apache.org>
Content-Type: text/plain; charset=ISO-8859-1

You seem to want to re-sort/partition your data without materializing
it onto HDFS.

Azuryy is right: There isn't a way right now and a second job (with an
identity mapper) is necessary. With YARN this is more possible to
implement into the project, though.

The newly inducted incubator project Tez sorta targets this. Its in
its nascent stages though (for general user use), and the website
should hopefully appear at
http://incubator.apache.org/projects/tez.html soon. Meanwhile, you can
read the proposal behind this project at
http://wiki.apache.org/incubator/TezProposal. Initial sources are at
https://svn.apache.org/repos/asf/incubator/tez/trunk/.

On Sun, Mar 24, 2013 at 6:33 PM, Fatih Haltas <fatih.haltas@nyu.edu> wrote:
> I want to get reduce output as key and value then I want to pass them to a
> new reduce as input key and input value.
>
> So is there any Map-Reduce-Reduce kind of method?
>
> Thanks to all.


-- 
Harsh J