hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Torsten Curdt <tcu...@apache.org>
Subject [RT] map reduce "pipelines"
Date Wed, 09 Jun 2010 01:02:38 GMT
At Cocoon we have a construct that we called pipelines.
And frankly speaking I am currently missing something similar in hadoop.

It would be so great if the API was to allow thing like this

M -> M -> R

M -> R -> R

M --> R
    \-> R

M --> R
M -/

Of course supporting also multiple inputs and outputs.

The current hadoop processing model feels so overly restrictive too me.
But it could just be me not knowing better.

Any comments?

cheers
--
Torsten

Mime
View raw message