Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 498C7193B9 for ; Tue, 1 Mar 2016 07:12:21 +0000 (UTC) Received: (qmail 89549 invoked by uid 500); 1 Mar 2016 07:12:19 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 89475 invoked by uid 500); 1 Mar 2016 07:12:19 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 89465 invoked by uid 99); 1 Mar 2016 07:12:19 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Mar 2016 07:12:19 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 548A41A0643 for ; Tue, 1 Mar 2016 07:12:18 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.179 X-Spam-Level: * X-Spam-Status: No, score=1.179 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id Ou3Q0M3WHUvz for ; Tue, 1 Mar 2016 07:12:16 +0000 (UTC) Received: from mail-lf0-f53.google.com (mail-lf0-f53.google.com [209.85.215.53]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 0A0FE5F341 for ; Tue, 1 Mar 2016 07:12:16 +0000 (UTC) Received: by mail-lf0-f53.google.com with SMTP id j186so32779393lfg.2 for ; Mon, 29 Feb 2016 23:12:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to; bh=sR+wY8VaxyFLSEKxIvCmECb7vsBS8Zv4akcVE5PgVeA=; b=MXzpl3yRv2fi/RrYlvuoqqcJsJiuOqqkJSPG2GWUFLmPIFT+cIAkV6smbffH23kKK+ 1vDbo6JyNFWQ1TB+dC0GRdiB/nDvwVfchANGhghSXN5BijRse9JNaF+C4jj3s2Lq+Jy/ L5e/QfG06pxGeU8xO4C82uzhtetvSlJO13uxtynRiwKmOzweIq31jgrewdCxnPvOYbxr JCMPL81J+uKm7UHTxcjJopCEUu2foCg1j17qgSVJZ/Fl5dNR/Yk73lT//L5o+2kDY4ik Z3WLDEe5Pt7g/UnuNO0969hqLKyakmgWBSJUSlA3ayAywY8uLryr3LRhnC+H+JHZmltZ bHEw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to; bh=sR+wY8VaxyFLSEKxIvCmECb7vsBS8Zv4akcVE5PgVeA=; b=PAWLKqON4d+iP/inXvYa8rg0BhKJKcTqiT7VtXCt7VEsmpEZSYqlE6WyU6uStjirYG 2tIpGHq/kO0Pei+TegF3HjtLyo/a/ZzxMgNjlui4JsPu3tPUkRDrrkWfDiQ6zapDsIYB Wl0umwg9wthYrsiZ7Qr0Ex3OD4U14zwuUZPnyXWy5l5tgw20ttCUTmVzrYfVAVHW0/1o LnTDAKszwtqc/nmrVnTh16cxDv7tMuwmsJ93btN8pASOljrrKwq9abf7muZte/oyIzuU eZaT2PAPFZ0fK2Op9GmhfBTlaWFwoR/gy0AX17BDxvm0SOr8+hbNKMHzm5H9Skm9BCwH XhKw== X-Gm-Message-State: AD7BkJL4UaqVipwuYRQ2362A18CXeK1gLx2G9JAv6EPlSmm9u/YwJXn9UB14gRSwzlCDp+rYHinoSduTTPJp7A== MIME-Version: 1.0 X-Received: by 10.25.209.73 with SMTP id i70mr7373031lfg.0.1456816328855; Mon, 29 Feb 2016 23:12:08 -0800 (PST) Received: by 10.112.139.131 with HTTP; Mon, 29 Feb 2016 23:12:08 -0800 (PST) In-Reply-To: References: Date: Tue, 1 Mar 2016 10:12:08 +0300 Message-ID: Subject: Re: Hive-2.0.1 Release date From: Dmitry Tolpeko To: user@hive.apache.org Content-Type: multipart/alternative; boundary=001a1141fcaac8da63052cf77b95 --001a1141fcaac8da63052cf77b95 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Mich, >What is best way of using with Hive now? If we are talking about the command line: Hive/beeline CLI to execute standalone SQL statements; Hplsql if you need to surround them with procedural SQL (flow of control, loops, exception handlers, dynamic SQL etc.) Dmitry On Tue, Mar 1, 2016 at 9:50 AM, Mich Talebzadeh wrote: > Thanks Dmitry > > I can see > > cd $HIVE_HOME > find ./ -name '*hplsql*' > ./bin/ext/hplsql.sh > ./bin/hplsql.cmd > ./bin/hplsql > ./lib/hive-hplsql-2.0.0.jar > > hplsql > usage: hplsql > -d,--define Variable subsitution e.g. -d A=3DB or > --define A=3DB > -e HPL/SQL from command line > -f HPL/SQL from a file > -H,--help Print help information > --hiveconf Value for given property > --hivevar Variable subsitution e.g. --hivevar A= =3DB > -main Entry point (procedure or function name= ) > -offline,--offline Offline mode - skip SQL execution > -trace,--trace Print debug information > -version,--version Print HPL/SQL version > > What is best way of using with Hive now? > > > Cheers > > > Dr Mich Talebzadeh > > > > LinkedIn * https://www.linkedin.com/profile/view?id=3DAAEAAAAWh2gBxianrbJ= d6zP6AcPCCdOABUrV8Pw > * > > > > http://talebzadehmich.wordpress.com > > > > On 1 March 2016 at 06:39, Dmitry Tolpeko wrote: > >> Mich, >> >> To avoid confusion: HPLSQL is shipped with Hive 2.0 (and will be shipped >> with all further versions). So you can use it with Hive on Tez, Hive on = MR, >> and Hive on Spark. But now it is a separate tool: hplsql (like hive CLI, >> beeline CLI). What Alan meant is that it is not integrated to Hive >> *parser*, so there are 2 parsers now: Hive SQL and HPLSQL. >> >> HPLSQL acts as a SQL-skin, supports many SQL and PL/SQL dialects in orde= r >> to avoid code conversions (there are a lot of legacy code to be ported t= o >> Hive), so it is verbose. I am not sure if it makes sense to merge it wit= h >> Hive SQL parser, but definitely integration with Hive/beeline CLI, >> metastore (persistent store of procedures/functions), JDBC/ODBC will be >> helpful. >> >> Alan, I am ready to work on this, but we need to define the direction >> first so we have good and consistent design. >> >> Thanks, >> >> Dmitry >> >> On Tue, Mar 1, 2016 at 3:08 AM, Mich Talebzadeh < >> mich.talebzadeh@gmail.com> wrote: >> >>> Thanks. I believe Alan Gate mentioned that HPLSQL is not yet integrated >>> into Hive 2.0.May be later? >>> >>> Dr Mich Talebzadeh >>> >>> >>> >>> LinkedIn * https://www.linkedin.com/profile/view?id=3DAAEAAAAWh2gBxianr= bJd6zP6AcPCCdOABUrV8Pw >>> * >>> >>> >>> >>> http://talebzadehmich.wordpress.com >>> >>> >>> >>> On 1 March 2016 at 00:05, Sergey Shelukhin >>> wrote: >>> >>>> HPLSQL is available as part of Hive 2.0. I am not sure to which extent >>>> the integration goes as I wasn=E2=80=99t involved in that work. >>>> As far as I understand HPLSQL and Hive on Spark are kind of orthogonal= =E2=80=A6 >>>> >>>> Hive 2.0.1 is purely a bug fix release for Hive 2.0; Hive 2.1 will be >>>> the next feature release if some major feature is missing. >>>> >>>> From: Mich Talebzadeh >>>> Reply-To: "user@hive.apache.org" >>>> Date: Monday, February 29, 2016 at 15:53 >>>> To: "user@hive.apache.org" >>>> Subject: Re: Hive-2.0.1 Release date >>>> >>>> Hi Sergey, >>>> >>>> Will HPLSQL be part of 2.0.1.release? >>>> >>>> I am using 2.0 and found Hive on Spark to be much more stable. >>>> >>>> Thanks >>>> >>>> Dr Mich Talebzadeh >>>> >>>> >>>> >>>> LinkedIn * https://www.linkedin.com/profile/view?id=3DAAEAAAAWh2gBxian= rbJd6zP6AcPCCdOABUrV8Pw >>>> * >>>> >>>> >>>> >>>> http://talebzadehmich.wordpress.com >>>> >>>> >>>> >>>> On 29 February 2016 at 23:46, Sergey Shelukhin >>>> wrote: >>>> >>>>> Hi. It will be released when some critical mass of bugfixes is >>>>> accumulated. We already found some issues that would be nice to fix, = so it >>>>> may be some time in March. Is there a particular fix that interests y= ou? >>>>> >>>>> From: Oleksiy MapR >>>>> Reply-To: "user@hive.apache.org" >>>>> Date: Monday, February 29, 2016 at 00:43 >>>>> To: "user@hive.apache.org" >>>>> Subject: Hive-2.0.1 Release date >>>>> >>>>> Hi all! >>>>> >>>>> Are you planing to release Hive-2.0.1? If yes, when it probably may b= e? >>>>> >>>>> Thanks, >>>>> Oleksiy. >>>>> >>>> >>>> >>> >> > --001a1141fcaac8da63052cf77b95 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Mich,=C2=A0

>What is best way of using wi= th Hive now?

If we are talking about the comma= nd line: Hive/beeline CLI to execute standalone SQL statements; Hplsql if y= ou need to surround them with procedural SQL (flow of control, loops, excep= tion handlers, dynamic SQL etc.)=C2=A0

Dmitry<= /span>


On Tue, Mar 1, 2016 at 9:50 AM, Mich Talebzadeh <<= a href=3D"mailto:mich.talebzadeh@gmail.com" target=3D"_blank">mich.talebzad= eh@gmail.com> wrote:
Thanks Dmitry

I can see

cd $HIVE_HOME
find= ./ -name '*hplsql*'
./bin/ext/hplsql.sh
./bin/hplsql.cmd
= ./bin/hplsql
./lib/hive-hplsql-2.0.0.jar

=C2=A0hplsql
usage: hplsql
=C2=A0-d,--defi= ne <key=3Dvalue>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 Variable subsitution e.g. -d A=3DB or
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 --define A=3DB
=C2=A0-e <quoted-query-string>= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 HPL/SQL from command line<= br>=C2=A0-f <filename>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 HPL/S= QL from a file
=C2=A0-H,--help=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 Print help information
=C2=A0=C2=A0=C2=A0 --hiveco= nf <property=3Dvalue>=C2=A0=C2=A0 Value for given property
=C2=A0= =C2=A0=C2=A0 --hivevar <key=3Dvalue>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 Variable subsitution e.g. --hivevar A=3DB
=C2=A0-main &l= t;procname>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Entry point (procedure or function nam= e)
=C2=A0-offline,--offline=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Offline mode - skip SQL execution=C2=A0-trace,--trace=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Print debug infor= mation
=C2=A0-version,--version=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Print HPL/SQL version

What is best way of using with Hive now?


Cheers

<= font color=3D"#000000" face=3D"Calibri" size=3D"3">

Dr Mich Talebzadeh

=C2=A0

LinkedIn =C2=A0https://www.linkedin.com/profile/view?id=3DAAEAAAAWh2gBxianrbJd6zP6AcPC= CdOABUrV8Pw

=C2=A0

http://talebzade= hmich.wordpress.com

=C2=A0


On 1 March 2016 at 06:39, Dmitry Tolpeko <dmtolpeko@gmail.com> wrote:
Mich,

To avoid confusion: HPLSQL is shipped with Hi= ve 2.0 (and will be shipped with all further versions). So you can use it w= ith Hive on Tez, Hive on MR, and Hive on Spark. But now it is a separate to= ol: hplsql (like hive CLI, beeline CLI). What Alan meant is that it is not = integrated to Hive *parser*, so there are 2 parsers now: Hive SQL and HPLSQ= L.=C2=A0

HPLSQL acts as a SQL-skin, supports many = SQL and PL/SQL dialects in order to avoid code conversions (there are a lot= of legacy code to be ported to Hive), so it is verbose. I am not sure if i= t makes sense to merge it with Hive SQL parser, but definitely integration = with Hive/beeline CLI, metastore (persistent store of procedures/functions)= , JDBC/ODBC will be helpful. =C2=A0

Alan, I am rea= dy to work on this, but we need to define the direction first so we have go= od and consistent design.

Thanks,=C2=A0

Dmitry=C2=A0

On Tue, Mar 1, 2016 at 3:08 AM, Mich Talebzadeh <mich.talebzadeh@= gmail.com> wrote:
Thank= s. I believe Alan Gate mentioned that HPLSQL is not yet integrated into Hiv= e 2.0.May be later?


On 1 March 2016 at 00:05, Sergey Shelukhin <= span dir=3D"ltr"><sergey@hortonworks.com> wrote:
HPLSQL is available as part of Hive 2.0. I am not sure to which extent= the integration goes as I wasn=E2=80=99t involved in that work.
As far as I understand HPLSQL and Hive on Spark are kind of orthogonal= =E2=80=A6

Hive 2.0.1 is purely a bug fix release for Hive 2.0; Hive 2.1 will be = the next feature release if some major feature is missing.

From: Mich Talebzadeh <mich.talebzadeh@gma= il.com>
Reply-To: "user@hive.apache.org" <<= a href=3D"mailto:user@hive.apache.org" target=3D"_blank">user@hive.apache.o= rg>
Date: Monday, February 29, 2016 at = 15:53
To: "user@hive.apache.org" <user@hive.apache.org= >
Subject: Re: Hive-2.0.1 Release dat= e

Hi Sergey,

Will HPLSQL be part of 2.0.1.release?

I am using 2.0 and found Hive on Spark to be much more stable.

Thanks


On 29 February 2016 at 23:46, Sergey Shelukhin <= span dir=3D"ltr"> <sergey@hort= onworks.com> wrote:
Hi. It will be released when some critical mass of bugfixes is accumul= ated. We already found some issues that would be nice to fix, so it may be = some time in March. Is there a particular fix that interests you?

From: Oleksiy MapR <osayankin.maprtech@gm= ail.com>
Reply-To: "user@hive.apache.org" <<= a href=3D"mailto:user@hive.apache.org" target=3D"_blank">user@hive.apache.o= rg>
Date: Monday, February 29, 2016 at = 00:43
To: "user@hive.apache.org" <user@hive.apache.org= >
Subject: Hive-2.0.1 Release date

Hi all!

Are you planing to release Hive-2.0.1? If yes, when it probably may be?

Thanks,
Oleksiy.




--001a1141fcaac8da63052cf77b95--