hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Allen Wittenauer <awittena...@linkedin.com>
Subject [ANNOUNCEMENT] Azkaban is now open source!
Date Tue, 30 Mar 2010 21:31:06 GMT

    Many of you that attended the Bay Area HUG meeting in January* wanted to
know if and when LinkedIn would be open sourcing our simple batch scheduler
for Hadoop.  I'm pleased to announce that, yes, Azkaban is now available
under the Apache License!


    For those that aren't familiar, Azkaban is LinkedIn's solution to
running multiple, scheduled batch jobs (workflows) against our Hadoop grids.
It supports dependency chains, a web UI, job upload capability, Pig,
external-to-Hadoop steps, and more.

    While the project is still in its infancy, we have been using it
successfully for a variety of uses for about 9 months.  It drives some of
our most complex job flows and manages our ETL processes.

    We look forward to any questions/comments/bugs/features/patches you
might have. 

* - slides and video of the January HUG are available here:



View raw message