hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrey Stepachev <oct...@gmail.com>
Subject Re: Observer/Observable MapReduce
Date Fri, 25 Mar 2011 21:53:10 GMT
Look at http://yahoo.github.com/oozie/. May be it will helps you.

2011/3/25 Vishal Kapoor <vishal.kapoor.in@gmail.com>

> Can someone give me a direction on how to start a map reduce based on
> an outcome of another map reduce? ( nothing common between them apart
> from the first decides about the scope of the second.
>
> I might also want to set the scope of my second map reduce
> (from/after) my first map reduce(scope as in scan(start,stop)
>
> typically data comes in a few tables for us and we start crunching it
> and then adding some more data to man tables like info etc to get rid
> of table joins.
>
> a light weight framework will do better than a typical workflow management
> tool.
>
> thanks,
> Vishal Kapoor
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message