hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jimmy Wan <ji...@indeed.com>
Subject Re: how to run jobs every 30 minutes?
Date Tue, 28 Dec 2010 22:56:17 GMT
I've been using Cascading to act as "make" for my Hadoop processes for quite
some time. Unfortunately, even the most recent distribution of Cascading was
written against the deprecated Hadoop APIs (JobConf) that I'm looking to
replace. Does anyone have an alternative?

On Tue, Dec 14, 2010 at 18:02, Chris K Wensel <chris@wensel.net> wrote:

> Cascading also has the ability to only run 'stale' processes. Think 'make'
> file. When re-running a job where only one file of many has changed, this is
> a big win.

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message