Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2B38EC8C5 for ; Tue, 23 Jul 2013 09:56:59 +0000 (UTC) Received: (qmail 86569 invoked by uid 500); 23 Jul 2013 09:56:54 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 86363 invoked by uid 500); 23 Jul 2013 09:56:53 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 86356 invoked by uid 99); 23 Jul 2013 09:56:53 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 23 Jul 2013 09:56:53 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of balamurali102@gmail.com designates 209.85.214.46 as permitted sender) Received: from [209.85.214.46] (HELO mail-bk0-f46.google.com) (209.85.214.46) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 23 Jul 2013 09:56:47 +0000 Received: by mail-bk0-f46.google.com with SMTP id na10so2863211bkb.5 for ; Tue, 23 Jul 2013 02:56:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=x+upn3KIerAklb7REKhSuE/IKUVPHosT1PJBCbWiiBg=; b=m75aq2cOfYZhJ+CZtUgAwgxUCPj2CEXrVgAD3x/j3Ghul0BDQYZny47BygBfWCt+Uz gv/vbsoZRMtR3ueYd/8wKBq/xQ2pF8SS5y2udTOlxtKeP86NEw5AES1+pYk2sVPTx3uA 1/qU2WxUSAY8FqFptjFo/b7Zv2VpW9NSgWbXJX+r5QYVfbNKvfRHof6JQzKvJHdU5AVf fAMTcKcYmhP85h9N6I6e2BDiwbT5N81ICLkdmEUMieaZbZFaV9axA/XJOH7IAgkhRmBE gp8vU5k08zs+DHUkiQ/AEK4DcmRohIhfUPS9s8SJ7mRYd1cguFXGMVf4daN1pVzNhVvQ B3QQ== X-Received: by 10.205.116.1 with SMTP id fg1mr4506047bkc.169.1374573387448; Tue, 23 Jul 2013 02:56:27 -0700 (PDT) MIME-Version: 1.0 Received: by 10.205.12.4 with HTTP; Tue, 23 Jul 2013 02:56:07 -0700 (PDT) In-Reply-To: <7BF8720E-3C1B-47ED-B48F-7F3636A05A2D@gmail.com> References: <06006DDA5A27D541991944AC4117E7A96E1DE1C1@szxeml560-mbx.china.huawei.com> <7BF8720E-3C1B-47ED-B48F-7F3636A05A2D@gmail.com> From: Balamurali Date: Tue, 23 Jul 2013 15:26:07 +0530 Message-ID: Subject: Re: setting mapred.task.timeout programmatically from client To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=14dae94732ef7a31a104e22ace55 X-Virus-Checked: Checked by ClamAV on apache.org --14dae94732ef7a31a104e22ace55 Content-Type: text/plain; charset=ISO-8859-1 Ok thanks On Tue, Jul 23, 2013 at 3:02 PM, Ted Yu wrote: > For scheduling mechanism please take a look at oozie. > > Cheers > > On Jul 22, 2013, at 10:37 PM, Balamurali wrote: > > Hi, > > I configured hadoop-1.0.3, hbase-0.92.1 and hive-0.10.0 . > Created table in HBase.Inserted records.Processing the data using Hive. > I have to show a graph with some points ( 7 - 7 days or 12 for one > year).In one day records may include 1000 - lacks.I need to show average of > these 1000 - lacks records.is there any built in haddop mechanism to > process these records fast. > > Also I need to run a hive query or job (when we run a hive query actually > a job is submitting) in every 1 hour.Is there a scheduling mechanism in > hadoop to handle thsese > > > Please reply. > Balamurali > > > On Tue, Jul 23, 2013 at 10:02 AM, Eugene Koifman > wrote: > >> Than you both >> >> On Mon, Jul 22, 2013 at 8:16 PM, Devaraj k wrote: >> > 'mapred.task.timeout' is deprecated configuration. You can use >> 'mapreduce.task.timeout' property to do the same. >> > >> > You could set this configuration while submitting the Job using >> org.apache.hadoop.conf.Configuration.setLong(String name, long value) API >> from conf or JobConf. >> > >> > Thanks >> > Devaraj k >> > >> > -----Original Message----- >> > From: Eugene Koifman [mailto:ekoifman@hortonworks.com] >> > Sent: 23 July 2013 04:24 >> > To: user@hadoop.apache.org >> > Subject: setting mapred.task.timeout programmatically from client >> > >> > Hello, >> > is there a way to set mapred.task.timeout programmatically from client? >> > >> > Thank you >> > > --14dae94732ef7a31a104e22ace55 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Ok thanks


On Tue, Jul 23, 2013 at 3:02 PM, Ted Yu <yuzhihon= g@gmail.com> wrote:
For scheduling mechan= ism please take a look at oozie.=A0

Cheers

On Jul 22, 2013, at 10:37 PM, Balamurali <balamurali102@gmail.com> wro= te:

=
Hi,

I configured hadoop-1.0.3, hbase-0.92.1 and hive-0.1= 0.0 .
Created table in HBase.Inserted records.Processing the data = using Hive.
I have to show a graph with some points ( 7 - 7 d= ays or 12 for one year).In one day records may include 1000 - lacks.I need to show average of=20 these 1000 - lacks records.= is there any built in haddop mechanism to=20 process these records fast.

Also I need to run a hive=20 query=A0 or job (when we run a hive query actually a job is submitting) in every 1 hour.Is there a scheduling mechanism in hadoop to handle thsese

Please reply.
Balamurali


On Tue, Jul 23, 2013 at 10:02 = AM, Eugene Koifman <ekoifman@hortonworks.com> wrote:<= br>
Than you both

On Mon, Jul 22, 2013 at 8:16 PM, Devaraj k <devaraj.k@huawei.com> wrote:
> 'mapred.task.timeout' is deprecated configuration. You can use= 'mapreduce.task.timeout' property to do the same.
>
> You could set this configuration while submitting the Job using org.ap= ache.hadoop.conf.Configuration.setLong(String name, long value) API from co= nf or JobConf.
>
> Thanks
> Devaraj k
>
> -----Original Message-----
> From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
> Sent: 23 July 2013 04:24
> To: user@h= adoop.apache.org
> Subject: setting mapred.task.timeout programmatically from client
>
> Hello,
> is there a way to set mapred.task.timeout programmatically from client= ?
>
> Thank you


--14dae94732ef7a31a104e22ace55--