hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Torsten Curdt <tcu...@apache.org>
Subject [RT] map reduce "pipelines"
Date Wed, 09 Jun 2010 01:02:38 GMT
At Cocoon we have a construct that we called pipelines.
And frankly speaking I am currently missing something similar in hadoop.

It would be so great if the API was to allow thing like this

M -> M -> R

M -> R -> R

M --> R
    \-> R

M --> R
M -/

Of course supporting also multiple inputs and outputs.

The current hadoop processing model feels so overly restrictive too me.
But it could just be me not knowing better.

Any comments?


View raw message