hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From daniel sikar <dsi...@gmail.com>
Subject Re: running hadoop jobs from within a program
Date Fri, 12 Nov 2010 08:55:17 GMT
I suggest you write a loop in your bash script, grepping for finished,
then take it from there.
Also, you can submit the same job as many times as you like.

On 12 November 2010 02:17, web service <wbsrvc@gmail.com> wrote:
> Hi,
>  Currently I run my sample hadoop job from a bash script using the
> following command ...
> [code]
> tmp="$HADOOP_BIN jar $JAR_LOC  $MAIN_CLASS /user/joe/input/input-$i/
> /user/vadmin/output/output-$i/
> $tmp
> [/code]
> However, I would want to write a timer that would do some cleanup after the
> jobs are  complete and restart the jobs after x hours. What I am looking for
> is
> the ability to invoke job from within a program and not the jar command
> thing.
> -Mac

View raw message