hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeff Hammerbacher <ham...@cloudera.com>
Subject Re: Is it better to have a linear chain of 2 jobs?!!
Date Fri, 11 Sep 2009 09:51:06 GMT
Hey,

Within the Apache Hadoop project, there is also an underdocumented tool
called JobControl to allow you to submit a sequence of jobs:
http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/mapred/jobcontrol/JobControl.html
.
Regards,
Jeff

On Thu, Sep 10, 2009 at 10:41 AM, Jonathan Gray <jlist@streamy.com> wrote:

> Sometimes you have to, simple as that.
>
> There are tools out there like Cascading (http://www.cascading.org) that
> are designed to help write multi-job chains.
>
> JG
>
>
> Xine Jar wrote:
>
>> Hallo,
>> I have already written several simple mapreduce applications always 1
>> job/application.
>> Assume I want to write a more complex application !! Can someone tell me
>> what is the advantage of splitting the application into two or more linear
>> jobs?
>>
>> Regards,
>> CJ
>>
>>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message