hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Amogh Vasekar <am...@yahoo-inc.com>
Subject Re: Hadoop automatic job status check and notification?
Date Wed, 17 Feb 2010 06:44:51 GMT
When you submit a job to the cluster, you can control the behavior for blocking / return using
JobClient's submitJob, runJob methods. It will also let you know if the job was successful
or failed, so you can design your follow up scripts accordingly.


On 2/17/10 11:01 AM, "jiang licht" <licht_jiang@yahoo.com> wrote:

New to Hadoop (now using 0.20.1), I want to do the following:

Automatic status check and notification of hadoop jobs such that e.g. when a job is finished,
a script can be trigged so that job results can be automatically pulled back to local machines
and expensive hadoop cluster can be released or shutdown.

So, what is the best way to do this?


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message