Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8BC958D84 for ; Fri, 26 Aug 2011 19:14:10 +0000 (UTC) Received: (qmail 54947 invoked by uid 500); 26 Aug 2011 19:14:09 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 54838 invoked by uid 500); 26 Aug 2011 19:14:09 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 54830 invoked by uid 99); 26 Aug 2011 19:14:09 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 26 Aug 2011 19:14:09 +0000 X-ASF-Spam-Status: No, hits=1.6 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of amitsharma1708@gmail.com designates 209.85.161.176 as permitted sender) Received: from [209.85.161.176] (HELO mail-gx0-f176.google.com) (209.85.161.176) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 26 Aug 2011 19:14:01 +0000 Received: by gxk7 with SMTP id 7so4174285gxk.35 for ; Fri, 26 Aug 2011 12:13:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=eoYB39ZUTUTyb3P/MtlyMrfdOg/xTdfLPPxdQYIaM7Y=; b=vgbBS9hp0qhOOjxkHClIluBFWqlf9q/pguDhAUucSK8e/r1ZNTwJkNoXKpo/cqoBBN 0MScAHHOMxGpVrKgsBsGFU/27OLE3+61vx7fbyEmyd+aH8Wbht60rDUzjTMnxTw24Yhm JhPDN7RaYj0TQ8ZJMrr80le43/3j8ULf+pvko= MIME-Version: 1.0 Received: by 10.150.68.34 with SMTP id q34mr2484088yba.18.1314386021016; Fri, 26 Aug 2011 12:13:41 -0700 (PDT) Received: by 10.151.51.1 with HTTP; Fri, 26 Aug 2011 12:13:40 -0700 (PDT) In-Reply-To: References: <203418E391884C2588622B3EDFC94D6E@china.huawei.com> Date: Fri, 26 Aug 2011 12:13:40 -0700 Message-ID: Subject: Re: Hive Custom UDF - "hive.aux.jars.path" not working From: Amit Sharma To: Chinna Rao Lalam 72745 Cc: user@hive.apache.org Content-Type: multipart/alternative; boundary=000e0cd59366e1656f04ab6d574a X-Virus-Checked: Checked by ClamAV on apache.org --000e0cd59366e1656f04ab6d574a Content-Type: text/plain; charset=ISO-8859-1 Do you know anyway in which this can be done in "Hive Server" ? Amit On Tue, Aug 23, 2011 at 11:21 AM, Chinna Rao Lalam 72745 < chinnarao@huawei.com> wrote: > > Hi Amit, > > Pls check this issue HIVE-1405 it will help u .This issue targeting same > scenario. > > Thanks > Chinna Rao Lalam > > > Hi Chinna, > > That worked, Thanks a lot. So once the jar is picked up, is > > there a way > > to create a temporary function, that is retained even if i quit the > > interactive shell and start it again? Or do i have to use the create > > command to register the function everytime? > > > > Thanks. > > Amit > > > > On Mon, Aug 22, 2011 at 10:00 PM, Chinna wrote: > > > > > Hi,**** > > > > > > **** > > > > > > U need to mention the jar like this,**** > > > > > > ** ** > > > > > > ~/Documents/workspace/Hive_0_7_1/build/dist/conf$grep aux hive- > > site.xml> > > > > > > hive.aux.jars.path/Users/amsharma/dev/Perforce/development/depot/dataeng/hive/dist> > */{URJARNAME}.jar* > > > > > > **** > > > > > > ** ** > > > > > > U r using CLI mode so after changing the value if u start > > shell that is > > > ok...and in another mode also we can start hive that is > > hiveserver this case > > > after changing the value u need to restart the hive server**** > > > > > > ** ** > > > > > > Thanks,**** > > > > > > Chinna Rao Lalam**** > > > ------------------------------ > > > > > > *From:* Amit Sharma [mailto:amitsharma1708@gmail.com] > > > *Sent:* Tuesday, August 23, 2011 3:35 AM > > > > > > *To:* user@hive.apache.org > > > *Subject:* Re: Hive Custom UDF - "hive.aux.jars.path" not > > working****> > > > ** ** > > > > > > Hi Vaibhav, > > > Excuse my ignorance as im a little new to Hive. What do you > > mean by > > > restart the Hive Server? I am using the Hive Interactive shell > > for my work. > > > So i start the shell after modifying the config variable. Which > > server do i > > > need to restart? > > > > > > Amit**** > > > > > > On Mon, Aug 22, 2011 at 2:49 PM, Aggarwal, Vaibhav > > > wrote:**** > > > > > > Did you restart the hive server after modifying the hive- > > site.xml settings? > > > **** > > > > > > I think you need to restart the server to pick up the latest > > settings in > > > the config file.**** > > > > > > **** > > > > > > Thanks**** > > > > > > Vaibhav**** > > > > > > **** > > > > > > *From:* Amit Sharma [mailto:amitsharma1708@gmail.com] > > > *Sent:* Monday, August 22, 2011 2:42 PM > > > *To:* user@hive.apache.org > > > *Subject:* Hive Custom UDF - "hive.aux.jars.path" not working**** > > > > > > **** > > > > > > Hi, > > > I build custom UDFS for hive and they seem to work fine when i > > explicitly> register the jars using the "add jar " > > command or put in in the > > > environment variable "HIVE_AUX_JARS_PATH". But if i add it as a > > > configuration variable in the hive-site.xml file and try to > > register the > > > function using "create temporary function as > > 'funciton' ", it > > > cannot find the jar. Any idea whats going on here? > > > > > > Here is the snippet from hive-site.xml: > > > > > > ~/Documents/workspace/Hive_0_7_1/build/dist/conf$grep aux hive- > > site.xml> > > > > > > hive.aux.jars.path/Users/amsharma/dev/Perforce/development/depot/dataeng/hive/dist> > > > Amit**** > > > > > > ** ** > > > > > > --000e0cd59366e1656f04ab6d574a Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Do you know anyway in which this can be done in=A0 "Hive Server" = ?

Amit

On Tue, Aug 23, 2011 at 11:= 21 AM, Chinna Rao Lalam 72745 <chinnarao@huawei.com> wrote:

Hi Amit,

=A0Pls check this issue HIVE-1405 it will help u .This issue targeting sam= e scenario.

Thanks
Chinna Rao Lalam

> Hi Chinna,
> =A0 That worked, Thanks a lot. So once the jar is picked up, is
> there a way
> to create a temporary function, that is retained even if i quit the > interactive shell and start it again? =A0Or do i have to use the creat= e
> command to register the function everytime?
>
> Thanks.
> Amit
>
> On Mon, Aug 22, 2011 at 10:00 PM, Chinna <chinnarao@huawei.com> wrote:
>
> > =A0Hi,****
> >
> > =A0 ****
> >
> > =A0 U need to mention the jar like this,****
> >
> > ** **
> >
> > ~/Documents/workspace/Hive_0_7_1/build/dist/conf$grep aux hive- > site.xml>
> >
> <property><name>hive.aux.jars.path</name><value&g= t;/Users/amsharma/dev/Perforce/development/depot/dataeng/hive/dist> */{U= RJARNAME}.jar*</value></property>
> >
> > ****
> >
> > ** **
> >
> > =A0U r using CLI mode =A0so after changing the value if u start > shell that is
> > ok...and in another mode also we can start hive that is
> hiveserver this case
> > after changing the value u need to restart the hive server**** > >
> > ** **
> >
> > Thanks,****
> >
> > Chinna Rao Lalam****
> > =A0------------------------------
> >
> > *From:* Amit Sharma [mailto:amitsharma1708@gmail.com]
> > *Sent:* Tuesday, August 23, 2011 3:35 AM
> >
> > *To:* user@hive.apache.or= g
> > *Subject:* Re: Hive Custom UDF - "hive.aux.jars.path" n= ot
> working****>
> > ** **
> >
> > Hi Vaibhav,
> > =A0 Excuse my ignorance as im a little new to Hive. What do you > mean by
> > restart the Hive Server? I am using the Hive Interactive shell > for my work.
> > So i start the shell after modifying the config variable. Which > server do i
> > need to restart?
> >
> > Amit****
> >
> > On Mon, Aug 22, 2011 at 2:49 PM, Aggarwal, Vaibhav
> <vaggarw@amazon.com>&g= t; wrote:****
> >
> > Did you restart the hive server after modifying the hive-
> site.xml settings?
> > ****
> >
> > I think you need to restart the server to pick up the latest
> settings in
> > the config file.****
> >
> > =A0****
> >
> > Thanks****
> >
> > Vaibhav****
> >
> > =A0****
> >
> > *From:* Amit Sharma [mailto:amitsharma1708@gmail.com]
> > *Sent:* Monday, August 22, 2011 2:42 PM
> > *To:* user@hive.apache.or= g
> > *Subject:* Hive Custom UDF - "hive.aux.jars.path" not w= orking****
> >
> > =A0****
> >
> > Hi,
> > =A0 I build custom UDFS for hive and they seem to work fine when = i
> explicitly> register the jars using the "add jar <jarname&g= t;"
> command or put in in the
> > environment variable "HIVE_AUX_JARS_PATH". But if i add= it as a
> > configuration variable in the hive-site.xml file and try to
> register the
> > function using "create temporary function <functionname&g= t; as
> 'funciton' ", it
> > cannot find the jar. Any idea whats going on here?
> >
> > Here is the snippet from hive-site.xml:
> >
> > ~/Documents/workspace/Hive_0_7_1/build/dist/conf$grep aux hive- > site.xml>
> >
> <property><name>hive.aux.jars.path</name><value&g= t;/Users/amsharma/dev/Perforce/development/depot/dataeng/hive/dist</valu= e></property>>
> > Amit****
> >
> > ** **
> >
>

--000e0cd59366e1656f04ab6d574a--