Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6E96C19A5A for ; Tue, 1 Mar 2016 10:35:13 +0000 (UTC) Received: (qmail 71425 invoked by uid 500); 1 Mar 2016 10:35:11 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 71354 invoked by uid 500); 1 Mar 2016 10:35:11 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 71344 invoked by uid 99); 1 Mar 2016 10:35:11 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Mar 2016 10:35:11 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 5BCF01805A8 for ; Tue, 1 Mar 2016 10:35:11 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.179 X-Spam-Level: ** X-Spam-Status: No, score=2.179 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_REPLY=1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id nQtScia3Z20k for ; Tue, 1 Mar 2016 10:35:08 +0000 (UTC) Received: from mail-ig0-f182.google.com (mail-ig0-f182.google.com [209.85.213.182]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 8F7575FBBD for ; Tue, 1 Mar 2016 10:35:07 +0000 (UTC) Received: by mail-ig0-f182.google.com with SMTP id y8so16928679igp.0 for ; Tue, 01 Mar 2016 02:35:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to; bh=ABNIXE9fP1Y2pQxY5+ec5AxYb1sZQrKfJheIpqE0i7E=; b=XyeW/4rIBWfS7uToZEQn/xxEZaLuoNQjo4NlDDa43yKSoynjT+BlPbW+TOWmXNDGH0 nthLgBqtItXucTwOBT7TfUfewyryXL5+EvAktpgyQS1fEx/1IyMWfBkyFis9F/inkJUg nG/5dnR9XhewrTAVjx+DPXrlX15lOc4i4vEDPD2xYFDZs/b4dpGh7KX6PTlaNUaZz84K jSk9ypEKgd4Iczkd+CF8uszVOXYfwHahq2aCDAWfFB2ItFFBFS8AAHBwWhks4/R4yKyU Zv7q6P/50tL+lTa348k3WZz3RFitrAhoOX0bkiKmNEtoyWEuo7l5eq1P23KT4fmp+HT9 zvmQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to; bh=ABNIXE9fP1Y2pQxY5+ec5AxYb1sZQrKfJheIpqE0i7E=; b=WsxaRCA7AM4r9lAbPA49woz9oIT5qZHZa/YnuHjGYt5Z2YJanfIb7wAitnfb06TkVA Sdjl+izbO2RBKWAcYqmogvnZjbl7t7zhkU64tDWD0SZfFGqortZTB7h+5oFJvJwaVIXy Xp2KlK2HQclGUZX6rtXvLEOOAKkDbaLuYEP5si5KG9zadi7fnlqgwI5bUDxLoYlfgQj9 fmw8yJ5MeIO/4jm9Sm7cEFdO6FQZjhUGKWvxBrGWLNAAm4nUsincLkBnwgZA086jxBh1 LJEJNcPmxI31DR7x9VdI2rtpMYfr47Qj4wpnyHB8aVLvdWYVUxXEaqvEiw1wRKgdDiii C/BQ== X-Gm-Message-State: AD7BkJIhirRMQVDYM9frh+Gs1vpNvp7w9pQT5+JkXE0QKDtVO+JUdxNGOhl+ayfowmytVtL+gXn0A5gOScgAUQ== MIME-Version: 1.0 X-Received: by 10.50.78.227 with SMTP id e3mr2609546igx.64.1456828506368; Tue, 01 Mar 2016 02:35:06 -0800 (PST) Received: by 10.79.122.145 with HTTP; Tue, 1 Mar 2016 02:35:06 -0800 (PST) In-Reply-To: References: Date: Tue, 1 Mar 2016 12:35:06 +0200 Message-ID: Subject: Re: Hive-2.0.1 Release date From: Oleksiy MapR To: user@hive.apache.org Content-Type: multipart/alternative; boundary=089e0111b7349ef3b8052cfa51e0 --089e0111b7349ef3b8052cfa51e0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable >> Hi. It will be released when some critical mass of bugfixes is accumulated. We already found >> some issues that would be nice to fix, so it may be some time in March. Is there a particular fix >> that interests you? Hi Sergey! Thanks for the information. There is no particular fix I want to see. It is common case to have additional release with small fixed after a great release, so I wanted to know the terms of it. Oleksiy. On Tue, Mar 1, 2016 at 9:12 AM, Dmitry Tolpeko wrote: > Mich, > > >What is best way of using with Hive now? > > If we are talking about the command line: Hive/beeline CLI to execute > standalone SQL statements; Hplsql if you need to surround them with > procedural SQL (flow of control, loops, exception handlers, dynamic SQL > etc.) > > Dmitry > > > On Tue, Mar 1, 2016 at 9:50 AM, Mich Talebzadeh > wrote: > >> Thanks Dmitry >> >> I can see >> >> cd $HIVE_HOME >> find ./ -name '*hplsql*' >> ./bin/ext/hplsql.sh >> ./bin/hplsql.cmd >> ./bin/hplsql >> ./lib/hive-hplsql-2.0.0.jar >> >> hplsql >> usage: hplsql >> -d,--define Variable subsitution e.g. -d A=3DB o= r >> --define A=3DB >> -e HPL/SQL from command line >> -f HPL/SQL from a file >> -H,--help Print help information >> --hiveconf Value for given property >> --hivevar Variable subsitution e.g. --hivevar = A=3DB >> -main Entry point (procedure or function nam= e) >> -offline,--offline Offline mode - skip SQL execution >> -trace,--trace Print debug information >> -version,--version Print HPL/SQL version >> >> What is best way of using with Hive now? >> >> >> Cheers >> >> >> Dr Mich Talebzadeh >> >> >> >> LinkedIn * https://www.linkedin.com/profile/view?id=3DAAEAAAAWh2gBxianrb= Jd6zP6AcPCCdOABUrV8Pw >> * >> >> >> >> http://talebzadehmich.wordpress.com >> >> >> >> On 1 March 2016 at 06:39, Dmitry Tolpeko wrote: >> >>> Mich, >>> >>> To avoid confusion: HPLSQL is shipped with Hive 2.0 (and will be shippe= d >>> with all further versions). So you can use it with Hive on Tez, Hive on= MR, >>> and Hive on Spark. But now it is a separate tool: hplsql (like hive CLI= , >>> beeline CLI). What Alan meant is that it is not integrated to Hive >>> *parser*, so there are 2 parsers now: Hive SQL and HPLSQL. >>> >>> HPLSQL acts as a SQL-skin, supports many SQL and PL/SQL dialects in >>> order to avoid code conversions (there are a lot of legacy code to be >>> ported to Hive), so it is verbose. I am not sure if it makes sense to m= erge >>> it with Hive SQL parser, but definitely integration with Hive/beeline C= LI, >>> metastore (persistent store of procedures/functions), JDBC/ODBC will be >>> helpful. >>> >>> Alan, I am ready to work on this, but we need to define the direction >>> first so we have good and consistent design. >>> >>> Thanks, >>> >>> Dmitry >>> >>> On Tue, Mar 1, 2016 at 3:08 AM, Mich Talebzadeh < >>> mich.talebzadeh@gmail.com> wrote: >>> >>>> Thanks. I believe Alan Gate mentioned that HPLSQL is not yet integrate= d >>>> into Hive 2.0.May be later? >>>> >>>> Dr Mich Talebzadeh >>>> >>>> >>>> >>>> LinkedIn * https://www.linkedin.com/profile/view?id=3DAAEAAAAWh2gBxian= rbJd6zP6AcPCCdOABUrV8Pw >>>> * >>>> >>>> >>>> >>>> http://talebzadehmich.wordpress.com >>>> >>>> >>>> >>>> On 1 March 2016 at 00:05, Sergey Shelukhin >>>> wrote: >>>> >>>>> HPLSQL is available as part of Hive 2.0. I am not sure to which exten= t >>>>> the integration goes as I wasn=E2=80=99t involved in that work. >>>>> As far as I understand HPLSQL and Hive on Spark are kind of orthogona= l=E2=80=A6 >>>>> >>>>> Hive 2.0.1 is purely a bug fix release for Hive 2.0; Hive 2.1 will be >>>>> the next feature release if some major feature is missing. >>>>> >>>>> From: Mich Talebzadeh >>>>> Reply-To: "user@hive.apache.org" >>>>> Date: Monday, February 29, 2016 at 15:53 >>>>> To: "user@hive.apache.org" >>>>> Subject: Re: Hive-2.0.1 Release date >>>>> >>>>> Hi Sergey, >>>>> >>>>> Will HPLSQL be part of 2.0.1.release? >>>>> >>>>> I am using 2.0 and found Hive on Spark to be much more stable. >>>>> >>>>> Thanks >>>>> >>>>> Dr Mich Talebzadeh >>>>> >>>>> >>>>> >>>>> LinkedIn * https://www.linkedin.com/profile/view?id=3DAAEAAAAWh2gBxia= nrbJd6zP6AcPCCdOABUrV8Pw >>>>> * >>>>> >>>>> >>>>> >>>>> http://talebzadehmich.wordpress.com >>>>> >>>>> >>>>> >>>>> On 29 February 2016 at 23:46, Sergey Shelukhin >>>> > wrote: >>>>> >>>>>> Hi. It will be released when some critical mass of bugfixes is >>>>>> accumulated. We already found some issues that would be nice to fix,= so it >>>>>> may be some time in March. Is there a particular fix that interests = you? >>>>>> >>>>>> From: Oleksiy MapR >>>>>> Reply-To: "user@hive.apache.org" >>>>>> Date: Monday, February 29, 2016 at 00:43 >>>>>> To: "user@hive.apache.org" >>>>>> Subject: Hive-2.0.1 Release date >>>>>> >>>>>> Hi all! >>>>>> >>>>>> Are you planing to release Hive-2.0.1? If yes, when it probably may >>>>>> be? >>>>>> >>>>>> Thanks, >>>>>> Oleksiy. >>>>>> >>>>> >>>>> >>>> >>> >> > --089e0111b7349ef3b8052cfa51e0 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
>> Hi. It will be released when some = critical mass of bugfixes is accumulated. We already found
>> som= e issues that would be nice to fix, so it may be some time in March. Is the= re a particular fix
>> that interests you?

Hi Sergey= !

Thanks for the information. There is no particular fix I wan= t to see. It is common case to have additional release with small fixed aft= er a great release, so I wanted to know the terms of it.

Olek= siy.

On = Tue, Mar 1, 2016 at 9:12 AM, Dmitry Tolpeko <dmtolpeko@gmail.com&g= t; wrote:
Mich,= =C2=A0

>What is best way of using with Hi= ve now?

If we are talking about the com= mand line: Hive/beeline CLI to execute standalone SQL statements; Hplsql if= you need to surround them with procedural SQL (flow of control, loops, exc= eption handlers, dynamic SQL etc.)=C2=A0

Dmitry
=


On Tue, Mar 1, 2016 at 9:50 AM, Mich Talebzadeh <mich.talebzadeh@gmail.com> wrote:
Thanks Dmitry

I can see
=
cd $HIV= E_HOME
find ./ -name '*hplsql*'
./bin/ext/hplsql.sh
./bin/= hplsql.cmd
./bin/hplsql
./lib/hive-hplsql-2.0.0.jar
<= div class=3D"gmail_extra">
=C2=A0hplsql
usage: hplsql=C2=A0-d,--define <key=3Dvalue>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 Variable subsitution e.g. -d A=3DB or
=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 --define A=3DB
=C2=A0-e <quoted-que= ry-string>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 HPL/SQL from = command line
=C2=A0-f <filename>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 HPL/SQL from a file
=C2=A0-H,--help=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Print help information
=C2=A0=C2=A0=C2= =A0 --hiveconf <property=3Dvalue>=C2=A0=C2=A0 Value for given propert= y
=C2=A0=C2=A0=C2=A0 --hivevar <key=3Dvalue>=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0 Variable subsitution e.g. --hivevar A=3DB
= =C2=A0-main <procname>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Entry point (procedure = or function name)
=C2=A0-offline,--offline=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Offline mode - skip = SQL execution
=C2=A0-trace,--trace=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Pr= int debug information
=C2=A0-version,--version=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Print HPL/SQL = version

What is best way of using with Hive now?


Cheers

<= font face=3D"Calibri" color=3D"#000000" size=3D"3">

Dr Mich Talebzadeh

=C2=A0

LinkedIn =C2=A0https://www.linkedin.com/profile/view?id=3DAAEAAAAWh2gBxianrbJd6zP6AcPC= CdOABUrV8Pw

=C2=A0

http://talebzade= hmich.wordpress.com

=C2=A0


On 1 March 2016 at 06:39, Dmitry Tolpeko <dmtolpeko@gmail.com> wrote:
Mich,

To avoid confusion: HPLSQL is shipped with Hi= ve 2.0 (and will be shipped with all further versions). So you can use it w= ith Hive on Tez, Hive on MR, and Hive on Spark. But now it is a separate to= ol: hplsql (like hive CLI, beeline CLI). What Alan meant is that it is not = integrated to Hive *parser*, so there are 2 parsers now: Hive SQL and HPLSQ= L.=C2=A0

HPLSQL acts as a SQL-skin, supports many = SQL and PL/SQL dialects in order to avoid code conversions (there are a lot= of legacy code to be ported to Hive), so it is verbose. I am not sure if i= t makes sense to merge it with Hive SQL parser, but definitely integration = with Hive/beeline CLI, metastore (persistent store of procedures/functions)= , JDBC/ODBC will be helpful. =C2=A0

Alan, I am rea= dy to work on this, but we need to define the direction first so we have go= od and consistent design.

Thanks,=C2=A0

Dmitry=C2=A0

On Tue, Mar 1, 2016 at 3:08 AM, Mich Talebzadeh <mich.talebzadeh@= gmail.com> wrote:
Thank= s. I believe Alan Gate mentioned that HPLSQL is not yet integrated into Hiv= e 2.0.May be later?


On 1 March 2016 at 00:05, Sergey Shelukhin <= span dir=3D"ltr"><sergey@hortonworks.com> wrote:
HPLSQL is available as part of Hive 2.0. I am not sure to which extent= the integration goes as I wasn=E2=80=99t involved in that work.
As far as I understand HPLSQL and Hive on Spark are kind of orthogonal= =E2=80=A6

Hive 2.0.1 is purely a bug fix release for Hive 2.0; Hive 2.1 will be = the next feature release if some major feature is missing.

From: Mich Talebzadeh <mich.talebzadeh@gma= il.com>
Reply-To: "user@hive.apache.org" <<= a href=3D"mailto:user@hive.apache.org" target=3D"_blank">user@hive.apache.o= rg>
Date: Monday, February 29, 2016 at = 15:53
To: "user@hive.apache.org" <user@hive.apache.org= >
Subject: Re: Hive-2.0.1 Release dat= e

Hi Sergey,

Will HPLSQL be part of 2.0.1.release?

I am using 2.0 and found Hive on Spark to be much more stable.

Thanks


On 29 February 2016 at 23:46, Sergey Shelukhin <= span dir=3D"ltr"> <sergey@hort= onworks.com> wrote:
Hi. It will be released when some critical mass of bugfixes is accumul= ated. We already found some issues that would be nice to fix, so it may be = some time in March. Is there a particular fix that interests you?

From: Oleksiy MapR <osayankin.maprtech@gm= ail.com>
Reply-To: "user@hive.apache.org" <<= a href=3D"mailto:user@hive.apache.org" target=3D"_blank">user@hive.apache.o= rg>
Date: Monday, February 29, 2016 at = 00:43
To: "user@hive.apache.org" <user@hive.apache.org= >
Subject: Hive-2.0.1 Release date

Hi all!

Are you planing to release Hive-2.0.1? If yes, when it probably may be?

Thanks,
Oleksiy.





--089e0111b7349ef3b8052cfa51e0--