hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <tdunn...@maprtech.com>
Subject Re: how to run jobs every 30 minutes?
Date Tue, 28 Dec 2010 23:50:05 GMT
Good quote.

On Tue, Dec 28, 2010 at 3:46 PM, Chris K Wensel <chris@wensel.net> wrote:

>
> deprecated is the new stable.
>
> https://issues.apache.org/jira/browse/MAPREDUCE-1734
>
> ckw
>
> On Dec 28, 2010, at 2:56 PM, Jimmy Wan wrote:
>
> > I've been using Cascading to act as "make" for my Hadoop processes for
> quite
> > some time. Unfortunately, even the most recent distribution of Cascading
> was
> > written against the deprecated Hadoop APIs (JobConf) that I'm looking to
> > replace. Does anyone have an alternative?
> >
> > On Tue, Dec 14, 2010 at 18:02, Chris K Wensel <chris@wensel.net> wrote:
> >
> >>
> >> Cascading also has the ability to only run 'stale' processes. Think
> 'make'
> >> file. When re-running a job where only one file of many has changed,
> this is
> >> a big win.
> >>
>
> --
> Chris K Wensel
> chris@concurrentinc.com
> http://www.concurrentinc.com
>
> -- Concurrent, Inc. offers mentoring, support, and licensing for Cascading
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message