hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Dunning" <ted.dunn...@gmail.com>
Subject Re: does anyone have idea on how to run multiple sequential jobs with bash script
Date Wed, 11 Jun 2008 21:16:24 GMT
Just a quick plug for Cascading.  Our team uses cascading quite a bit and
found it to be a simpler way to write map reduce jobs.  The guys using it
find it very helpful.

On Wed, Jun 11, 2008 at 1:31 PM, Chris K Wensel <chris@wensel.net> wrote:

>
> Depending on the nature of your jobs, Cascading has built in a topological
> scheduler. It will schedule all your work as their dependencies are
> satisfied. Dependencies being source data and inter-job intermediate data.
>
> http://www.cascading.org
>
>
>


-- 
ted

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message