hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris K Wensel <ch...@wensel.net>
Subject Re: how to run jobs every 30 minutes?
Date Tue, 28 Dec 2010 23:46:17 GMT

deprecated is the new stable.

https://issues.apache.org/jira/browse/MAPREDUCE-1734

ckw

On Dec 28, 2010, at 2:56 PM, Jimmy Wan wrote:

> I've been using Cascading to act as "make" for my Hadoop processes for quite
> some time. Unfortunately, even the most recent distribution of Cascading was
> written against the deprecated Hadoop APIs (JobConf) that I'm looking to
> replace. Does anyone have an alternative?
> 
> On Tue, Dec 14, 2010 at 18:02, Chris K Wensel <chris@wensel.net> wrote:
> 
>> 
>> Cascading also has the ability to only run 'stale' processes. Think 'make'
>> file. When re-running a job where only one file of many has changed, this is
>> a big win.
>> 

--
Chris K Wensel
chris@concurrentinc.com
http://www.concurrentinc.com

-- Concurrent, Inc. offers mentoring, support, and licensing for Cascading


Mime
View raw message