Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7B7AC18085 for ; Wed, 10 Feb 2016 19:09:31 +0000 (UTC) Received: (qmail 36598 invoked by uid 500); 10 Feb 2016 19:09:30 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 36527 invoked by uid 500); 10 Feb 2016 19:09:30 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 36517 invoked by uid 99); 10 Feb 2016 19:09:30 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Feb 2016 19:09:30 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id A0D6F1A030B for ; Wed, 10 Feb 2016 19:09:29 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.179 X-Spam-Level: * X-Spam-Status: No, score=1.179 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id cfa1yBwIlf16 for ; Wed, 10 Feb 2016 19:09:27 +0000 (UTC) Received: from mail-yk0-f173.google.com (mail-yk0-f173.google.com [209.85.160.173]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id B858E20BFB for ; Wed, 10 Feb 2016 19:09:26 +0000 (UTC) Received: by mail-yk0-f173.google.com with SMTP id r207so11794740ykd.2 for ; Wed, 10 Feb 2016 11:09:26 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=ZzloWH0pgU2DwhxT7Q2fXUKvyD6zvkujlW4dqdxZJoQ=; b=xHMrL5K/jHIyrpTMgz9qZBtYQAuMzHE98zVyYEGu0gTPzag79/Nz6NHSI082NJVzMm 026+6omyWuMX2cU2RG25tttWIdOoW9/swebsJPkEBn1UHTG1iFAS99Qk1fA33QUnjTkx o1GBNAIRvBc3iyh9RqbGOy0UFm+ij0dXcQAqgqtZGJiRqyYYMAcCcPnOSkULa/NUqVQv gB5DXhGYghYRGoc0gzQdhfaYp5jksIp0x7Sfxcj18PZsFA8IR+i2Rd/Mn9cBbEPNiY6p 53Xry/K5Ao9qXhs1vIq6QV7CFr1F8Hxzl0rZeUhlvrFSU2a3uLJk5iccqpk31zzVLNnd GYGA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=ZzloWH0pgU2DwhxT7Q2fXUKvyD6zvkujlW4dqdxZJoQ=; b=adEKTQ/7Xef1dbmSjxfx5qSs6EZtQSdKdnIVsgfApG8tIiuquyVJwP8NUWK6O8y/L4 6zGMwzzKZtrsmuCOdplSUEG7YLSM/OzgHh0gH3CzRm90wcVPN6pBPD8X2SMgm6lX1FAc E7mqMfxAdZ2pgtfoMuUQ5kM5+0kzAZCcVuoGj4G+7Jozl41am9J2UKGVX/qwYXgaotr1 K+tQWp0w5LV//e1AXx8DAZ26mCL6xN8IfRqidFogUQ8hiorDMtoTfnI75TKT23+U/hdY N1mjEBhRAswHWBYAN58RzYQq2zVrwXLa6yMzEwYVdOlFzonnht6ZYZDqpfL/sWJo+FC8 x9NQ== X-Gm-Message-State: AG10YOR54/adZYunk5yyAYcw/FHBK4TiGgB6Ec9KIM/tDoz1vEzVwpR4N/fA2ff6+aBIijqhbTc6NDq5u7lqRQ== X-Received: by 10.37.25.212 with SMTP id 203mr21143576ybz.163.1455131359903; Wed, 10 Feb 2016 11:09:19 -0800 (PST) MIME-Version: 1.0 Received: by 10.13.240.198 with HTTP; Wed, 10 Feb 2016 11:09:00 -0800 (PST) In-Reply-To: <3CE310CECADB9F46B5245852738136965C9FAEF3@PC1WEPSIEXDAG03> References: <3CE310CECADB9F46B5245852738136965C9F9AFE@PC1WEPSIEXDAG03> <3CE310CECADB9F46B5245852738136965C9FAEF3@PC1WEPSIEXDAG03> From: "Surendra , Manchikanti" Date: Wed, 10 Feb 2016 11:09:00 -0800 Message-ID: Subject: Re: Hive Permanent functions not working after a cluster restart. To: user@hive.apache.org Content-Type: multipart/alternative; boundary=001a113dc0c2cf0804052b6f2ba7 --001a113dc0c2cf0804052b6f2ba7 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Please check your metastore database tables refreshing after a restart ? Permanent functions will be stored in DB. -- Surendra Manchikanti On Wed, Feb 10, 2016 at 7:58 AM, Chagarlamudi, Prasanth < prasanth.chagarlamudi@epsilon.com> wrote: > Hi Surendra, > > Its Derby. > > > > Thanks > > Prasanth C > > > > *From:* Surendra , Manchikanti [mailto:surendra.manchikanti@gmail.com] > *Sent:* Tuesday, February 09, 2016 3:44 PM > *To:* user@hive.apache.org > *Subject:* Re: Hive Permanent functions not working after a cluster > restart. > > > > Hi, > > > > What's your meta store DB. Is it Derby (Internal) or external Database? > > > Regards, > > Surendra M > > > > On Fri, Feb 5, 2016 at 10:07 AM, Chagarlamudi, Prasanth < > prasanth.chagarlamudi@epsilon.com> wrote: > > I created permanent functions(rather than temp functions) in Hive to use > it across different sessions. It all works fine until I actually restart > the hive server or cluster for any reason. > > > > So is this the intended functionality of Permanent functions? > > Here is the hive doc link for Permanent functions. > > > https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#Langu= ageManualDDL-Create/Drop/ReloadFunction > > > > 1) Placed my utils jar for hive in hdfs location > hdfs:///opt/myUtiljars/myUtil.jar > > 2) Create function *schemaName.myFunctName* as =E2=80=98com.myclass.= name=E2=80=99 > using =E2=80=98hdfs:///opt/myUtiljars/myUtil.jar=E2=80=99 > > 3) Select *schemaName.myFunctName()* from tableName; > > > > This is what I did to create a permanent function through beeline. And > this is working fine in other beeline sessions as well. > > Now after I restart the servers I was able to see the functions name in > =E2=80=9Cshow functions;=E2=80=9D command but I cannot use this function = in any of my > queries. > > > > When I issue the command in 3) Error: Error while compiling statement: > FAILED: SemanticException Line 0:-1 Invalid function > *schemaName.myFunctName* ' (state=3D42000,code=3D40000) > > > > I would like to create Permanent functions as mentioned above and I don= =E2=80=99t > want to deal with them every time I restart. > > > > Any corrections(if I am missing anything) or suggestion are greatly > appreciated. > > > > Thanks in advance > > Prasanth Chagarlamudi > > > > > ------------------------------ > > > This e-mail and files transmitted with it are confidential, and are > intended solely for the use of the individual or entity to whom this e-ma= il > is addressed. If you are not the intended recipient, or the employee or > agent responsible to deliver it to the intended recipient, you are hereby > notified that any dissemination, distribution or copying of this > communication is strictly prohibited. If you are not one of the named > recipient(s) or otherwise have reason to believe that you received this > message in error, please immediately notify sender by e-mail, and destroy > the original message. Thank You. > > > > ------------------------------ > > This e-mail and files transmitted with it are confidential, and are > intended solely for the use of the individual or entity to whom this e-ma= il > is addressed. If you are not the intended recipient, or the employee or > agent responsible to deliver it to the intended recipient, you are hereby > notified that any dissemination, distribution or copying of this > communication is strictly prohibited. If you are not one of the named > recipient(s) or otherwise have reason to believe that you received this > message in error, please immediately notify sender by e-mail, and destroy > the original message. Thank You. > --001a113dc0c2cf0804052b6f2ba7 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Please check your=C2=A0metastore=C2=A0database tables refr= eshing after a restart ?=C2=A0Permanent functions will be stored in DB.

-- Surendra Manchikanti

On Wed, Feb 10, 2016 at 7:58 AM, Chagarlamud= i, Prasanth <prasanth.chagarlamudi@epsilon.com> wrote:

Hi Surendra,

Its Derby.<= /span>

=C2=A0

Thanks

Prasanth C<= /span>

=C2=A0

From: Surendra= , Manchikanti [mailto:surendra.manchikanti@gmail.com]
Sent: Tuesday, February 09, 2016 3:44 PM
To: user@h= ive.apache.org
Subject: Re: Hive Permanent functions not working after a cluster re= start.

=C2=A0

Hi,

=C2=A0

What's your meta store DB. Is it Derby (Internal= ) or external Database?


Regards,

Surendra M

=C2=A0

On Fri, Feb 5, 2016 at 10:07 AM, Chagarlamudi, Prasa= nth <prasanth.chagarlamudi@epsilon.com> wrote:

I created permanent functions(rather than temp funct= ions) in Hive to use it across different sessions. It all works fine until = I actually restart the hive server or cluster for any reason.

=C2=A0

So is this the intended functionality of=C2=A0 Perma= nent functions?

Here is the hive doc link for Permanent functions.

https://cwiki.apache.org/confluence/display/Hive/LanguageMa= nual+DDL#LanguageManualDDL-Create/Drop/ReloadFunction

=C2=A0

1)=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 = Placed my utils jar for hive in hdfs location hdfs:///opt/myUtiljars/myUtil= .jar

2)=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 = Create function schemaName.myFunctName as =E2=80=98com.myclass.name=E2=80=99 using = =E2=80=98hdfs:///opt/myUtiljars/myUtil.jar=E2=80=99

3)=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 = Select schemaName.myFunctName() from tableName;

=C2=A0

This is what I did to create a permanent function th= rough beeline. And this is working fine in other beeline sessions as well.

Now after I restart the servers I was able to see th= e functions name in =E2=80=9Cshow functions;=E2=80=9D command but I cannot = use this function in any of my queries.

=C2=A0

When I issue the command in 3) Error: Error while compiling statement: FAILED: S= emanticException Line 0:-1 Invalid function schemaName.myFunctName ' (state=3D42000,code=3D40000)<= /u>

=C2=A0

I would like to create Permanent functions as mentio= ned above and I don=E2=80=99t want to deal with them every time I restart.

=C2=A0

Any corrections(if I am missing anything) or suggest= ion are greatly appreciated.

=C2=A0

Thanks in advance

Prasanth Chagarlamudi

=C2=A0

=C2=A0


This e-mail and files transmitted with it are confidential, and are intende= d solely for the use of the individual or entity to whom this e-mail is add= ressed. If you are not the intended recipient, or the employee or agent res= ponsible to deliver it to the intended recipient, you are hereby notified that any dissemination, distribution or= copying of this communication is strictly prohibited. If you are not one o= f the named recipient(s) or otherwise have reason to believe that you recei= ved this message in error, please immediately notify sender by e-mail, and destroy the original message. Tha= nk You.

=C2=A0



This e-mail and files transmitted with it are confidential, and are intende= d solely for the use of the individual or entity to whom this e-mail is add= ressed. If you are not the intended recipient, or the employee or agent res= ponsible to deliver it to the intended recipient, you are hereby notified that any dissemination, distribution or= copying of this communication is strictly prohibited. If you are not one o= f the named recipient(s) or otherwise have reason to believe that you recei= ved this message in error, please immediately notify sender by e-mail, and destroy the original message. Tha= nk You.

--001a113dc0c2cf0804052b6f2ba7--