hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From asif md <asif.d...@gmail.com>
Subject Chaining Multiple Map reduce jobs.
Date Wed, 08 Apr 2009 21:30:15 GMT
hi everyone,

i have to chain multiple map reduce jobs < actually 2 to 4 jobs >, each of
the jobs depends on the o/p of preceding job. In the reducer of each job I'm
doing very little < just grouping by key from the maps>. I want to give the
output of one MapReduce job to the next job without having to go to the
disk. Does anyone have any ideas on how to do this?

Thanx.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message