Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A5AAD11B3A for ; Fri, 11 Jul 2014 17:18:07 +0000 (UTC) Received: (qmail 65307 invoked by uid 500); 11 Jul 2014 17:18:05 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 65240 invoked by uid 500); 11 Jul 2014 17:18:05 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 65227 invoked by uid 99); 11 Jul 2014 17:18:05 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Jul 2014 17:18:05 +0000 X-ASF-Spam-Status: No, hits=3.3 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS,URIBL_GREY X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jbanks@tagged.com designates 209.85.192.180 as permitted sender) Received: from [209.85.192.180] (HELO mail-pd0-f180.google.com) (209.85.192.180) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Jul 2014 17:18:01 +0000 Received: by mail-pd0-f180.google.com with SMTP id fp1so1726980pdb.11 for ; Fri, 11 Jul 2014 10:17:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tagged.com; s=gmail; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=51BMPFsPHL3fujMls2t7PyEJGpqcqDdWQwdgeHu8aAA=; b=zYfmcRncVsCRfCiGbhuwUUK6+9k2shb105WhqVHp+4/JfoxU2Ey27csQQSfpZGGwXj Ieyzw12wieRGblTeEdnJSkfvFowfs1m5yrKIS8qCVdTTTpM8UEn/zkIWO0cT7AFM0Qkk 4CigQWjNdu3shdtv6v67RjsE1z51uR+IVz+tM= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=51BMPFsPHL3fujMls2t7PyEJGpqcqDdWQwdgeHu8aAA=; b=f4MNdGRrD+r8acgHPWwzzSBPUibwY4/6d1TSwJsQmX67dZ0Cqtz1n9/NnKtlZBBw1H lFKN9DqDmJOHor9xO7gqbdjAm7MRIsadRuInHrQiLjYTYRdq49sat7n6Df9do/pnJg8c L9NXv0F4MOM7EPJT1cKoQMQBvDfD4v9zPFcmL16GYkcHnaHf3U08lAnL64KdVVGkHydb CC6uag1aXUYuJf95JOqFUUA1hjoMJYNZh7v+vYUue6M5AUiDTtHLtfoVqG2ZqogHun8D wGVuTf4ENFmruGNgU4ghZ6jJklRmsKF91Zl/JckhcXAll9GWwu6zPKJ4DGlFnVECGpmB k7og== X-Gm-Message-State: ALoCoQlWbmjMFKlrdF2HBwjkTx7AIC7jZH0F2n46V85YoL0DgHNL5hqaVESebISI3PpDzAl58nxl MIME-Version: 1.0 X-Received: by 10.70.43.43 with SMTP id t11mr126454pdl.49.1405099060448; Fri, 11 Jul 2014 10:17:40 -0700 (PDT) Received: by 10.70.103.80 with HTTP; Fri, 11 Jul 2014 10:17:40 -0700 (PDT) In-Reply-To: References: <25BF61B47BEC8A4FA272E242FF64087B18324A2818@TUS1XCHEVSPIN33.SYMC.SYMANTEC.COM> <18B4A8B4-3E24-4C2E-9A70-A4DCD02D707F@pssd.com> Date: Fri, 11 Jul 2014 10:17:40 -0700 Message-ID: Subject: Re: Hive job scheduling From: Jerome Banks To: user@hive.apache.org Content-Type: multipart/alternative; boundary=047d7bfea3fc5f687004fdee1e8b X-Virus-Checked: Checked by ClamAV on apache.org --047d7bfea3fc5f687004fdee1e8b Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cheng, We are working on an exciting new project called Satisfaction, to handle next generation scheduling and workflow for Hive and other Hadoop/BigData technologies. We plan to open source sometime in the near future. Stay tuned !!! --- jerome On Fri, Jul 11, 2014 at 7:02 AM, Xuefu Zhang wrote: > Or you can just run CRON tasks in your OS. > > > On Thu, Jul 10, 2014 at 4:55 PM, moon soo Lee > wrote: > >> for simpler use, Zeppelin (http://zeppelin-project.org) runs hive query >> with web based editor, and it's got cron tab style scheduler. >> >> Best, >> moon >> >> >> On Fri, Jul 11, 2014 at 8:52 AM, Martin, Nick wrote: >> >>> Oozie has a workflow action for Hive to execute scripts. You can also >>> configure an Oozie coordinator to run the Hive workflow at desired >>> intervals. Lots of Oozie config options for workflows and configs so ch= eck >>> out the documentation. >>> >>> Sent from my iPhone >>> >>> On Jul 10, 2014, at 6:09 PM, "Cheng Ju Chuang" < >>> ChengJu_Chuang@symantec.com> wrote: >>> >>> Hi, >>> >>> >>> >>> Hopefully it won=E2=80=99t be an extra mail for you guys because I keep= getting >>> deliver error. >>> >>> >>> >>> I am looking for any scheduling implementation for Hive job. (e.g. some >>> hive command have to be executed every 15 minutes.) It is supposed to b= e >>> some ways to achieve it but I haven=E2=80=99t find a stable way from on= line >>> community. Any suggestion? >>> >>> >>> >>> Btw, my hive version is 0.13 and Hadoop version is 2.2. I found a >>> project call Oozie from apache but I am not sure does it support versio= n of >>> my cluster. I will appreciate any suggestion. >>> >>> >>> >>> Thank you very much! >>> >>> >>> >>> Sincerely, >>> >>> Jeremy Chuang >>> >>> >>> >>> >> > --047d7bfea3fc5f687004fdee1e8b Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Cheng,
=C2=A0 We are working on an exciting new projec= t called Satisfaction, to handle next generation scheduling and workflow fo= r Hive and other Hadoop/BigData technologies. We plan to open source someti= me in the near future.
=C2=A0=C2=A0
Stay tuned !!!
--- jerome
=


On Fri, Jul 1= 1, 2014 at 7:02 AM, Xuefu Zhang <xzhang@cloudera.com> wrot= e:
Or you can just run CRON ta= sks in your OS.


On Thu, Jul 10, 2014 at 4:55 PM, moon so= o Lee <leemoonsoo@gmail.com> wrote:
for simpler use, Zeppelin (= http://zeppelin-p= roject.org) runs hive query with web based editor, and it's got cro= n tab style scheduler.

Best,
moon


On Fri, Jul 11, 2014 at 8:52 AM, Martin, Nick <NiMarti= n@pssd.com> wrote:
Oozie has a workflow action for Hive to execute scripts. You can also = configure an Oozie coordinator to run the Hive workflow at desired interval= s. Lots of Oozie config options for workflows and configs so check out the = documentation.=C2=A0

Sent from my iPhone

On Jul 10, 2014, at 6:09 PM, "Cheng Ju Chuang" <ChengJu_Chuang@symantec.= com> wrote:

Hi,

=C2=A0

Hopefully it won=E2=80=99t be an extra mail for you = guys because I keep getting deliver error.

=C2=A0

I am looking for any scheduling implementation for H= ive job. (e.g. some hive command have to be executed every 15 minutes.) It = is supposed to be some ways to achieve it but I haven=E2=80=99t find a stab= le way from online community. Any suggestion?

=C2=A0

Btw, my hive version is 0.13 and Hadoop version is 2= .2. I found a project call Oozie from apache but I am not sure does it supp= ort version of my cluster. I will appreciate any suggestion.<= /p>

=C2=A0

Thank you very much!

=C2=A0

Sincerely,

Jeremy Chuang

=C2=A0




--047d7bfea3fc5f687004fdee1e8b--