Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: general@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of dsikar@gmail.com designates
 209.85.160.176 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=huFXRxusytLdnfyRhnA1ZlieL6aeyTbPCCWpIdbgOyAAY8W7oXGIFXdcqAjLM4CrgH
         ekKJKHBpytcILIzqjPRxFrifWy99/tyTHH0nO/iTtqLbM8DgImRl3U1IxHyphSdTY3Db
         t+rBKAyS1mKa7Xi1tnNj5B8OmXshQ+ojtfVY8=
MIME-Version: 1.0
In-Reply-To: <AANLkTinQVUC0U9CEONpW13+MLXHOVQWAqfvyhG=1btjw@mail.gmail.com>
References: <AANLkTinQVUC0U9CEONpW13+MLXHOVQWAqfvyhG=1btjw@mail.gmail.com>
Date: Fri, 12 Nov 2010 08:55:17 +0000
Message-ID: <AANLkTinr0mO0N4c8+oqk1T5=9NbmdVxVpbbGJnxC4jKV@mail.gmail.com>
Subject: Re: running hadoop jobs from within a program
From: daniel sikar <dsikar@gmail.com>
To: general@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

I suggest you write a loop in your bash script, grepping for finished,
then take it from there.
Also, you can submit the same job as many times as you like.

On 12 November 2010 02:17, web service <wbsrvc@gmail.com> wrote:
> Hi,
> =A0Currently I run my sample hadoop job from a bash script using the
> following command ...
>
> [code]
> tmp=3D"$HADOOP_BIN jar $JAR_LOC =A0$MAIN_CLASS /user/joe/input/input-$i/
> /user/vadmin/output/output-$i/
> $tmp
> [/code]
>
> However, I would want to write a timer that would do some cleanup after t=
he
> jobs are =A0complete and restart the jobs after x hours. What I am lookin=
g for
> is
> the ability to invoke job from within a program and not the jar command
> thing.
>
> -Mac
>