hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jitendra Yadav <jeetuyadav200...@gmail.com>
Subject Re: how to schedule the hadoop commands in cron job or any orther way?
Date Thu, 07 Nov 2013 12:44:51 GMT
Hi,

If you have few and simpler hadoop jobs like for data ingestion or
manipulation etc. then you can easily manage it through some shell script
and put it in crontab. But in case you have bunch of complex and
interdependent jobs then you can use Oozie tool for configuring, scheduling
and monitoring your complex jobs effectively .

http://www.slideshare.net/martyhall/hadoop-tutorial-oozie

Regards
Jitendra
On Thu, Nov 7, 2013 at 5:48 PM, Mirko Kämpf <mirko.kaempf@gmail.com> wrote:

> Hi,
>
> it is easy to create a shell script which contains the hadoop jar ...
> command with all it's parameters.
> And this command can be used in your cron job.
> But are you sure, you are working on scheduling? Is it job submission you
> talk about? Scheduling in Hadoop is more related to tasks.
> Have a look on Oozie ...
>
> Best wishes
> Mirko
>
>
>
> 2013/11/7 mallik arjun <mallik.cloud@gmail.com>
>
>> hi all,
>>
>> i am working on scheduling.
>> can u please help me out how to write the hadoop commands in cronjob.
>>
>> thankyou,
>> mallik
>>
>
>

Mime
View raw message