hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alex Loddengaard <a...@cloudera.com>
Subject Re: Intermediate files generated.
Date Thu, 01 Jul 2010 22:14:31 GMT
You could use the HDFS API from within your mapper, and run with 0 reducers.

Alex

On Thu, Jul 1, 2010 at 3:07 PM, Pramy Bhats <pramybhats@googlemail.com>wrote:

> Hi,
>
> I am using hadoop framework for writing MapReduce jobs. I want  to redirect
> the output of Map into files of my choice and later use those files as
> input
> for Reduce phase.
>
>
> Could you please suggest, how to proceed for it ?
>
> thanks,
> --PB.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message