Return-Path: <user-return-797-archive-asf-public=cust-asf.ponee.io@kudu.apache.org>
X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io
Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io
Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183])
	by cust-asf2.ponee.io (Postfix) with ESMTP id 89AB6200C44
	for <archive-asf-public-internal@cust-asf2.ponee.io>; Mon, 27 Mar 2017 21:25:51 +0200 (CEST)
Received: by cust-asf.ponee.io (Postfix)
	id 88828160B85; Mon, 27 Mar 2017 19:25:51 +0000 (UTC)
Delivered-To: archive-asf-public@cust-asf.ponee.io
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by cust-asf.ponee.io (Postfix) with SMTP id D0AD7160B7B
	for <archive-asf-public@cust-asf.ponee.io>; Mon, 27 Mar 2017 21:25:50 +0200 (CEST)
Received: (qmail 32578 invoked by uid 500); 27 Mar 2017 19:25:50 -0000
Mailing-List: contact user-help@kudu.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@kudu.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@kudu.apache.org>
List-Post: <mailto:user@kudu.apache.org>
List-Id: <user.kudu.apache.org>
Reply-To: user@kudu.apache.org
Delivered-To: mailing list user@kudu.apache.org
Received: (qmail 32567 invoked by uid 99); 27 Mar 2017 19:25:50 -0000
Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Mar 2017 19:25:50 +0000
Received: from mail-wr0-f173.google.com (mail-wr0-f173.google.com [209.85.128.173])
	by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id 9D9731A05A7
	for <user@kudu.apache.org>; Mon, 27 Mar 2017 19:25:49 +0000 (UTC)
Received: by mail-wr0-f173.google.com with SMTP id u1so72067556wra.2
        for <user@kudu.apache.org>; Mon, 27 Mar 2017 12:25:49 -0700 (PDT)
X-Gm-Message-State: AFeK/H0/qRDMaeslX2NhUql/a3Nyvw1qIcim7selUqGcGxvw6HQm3AQ0c9HOb1hsOzVrX1BbQg+CRUR8HMsbhg==
X-Received: by 10.28.212.79 with SMTP id l76mr10985477wmg.6.1490642748221;
 Mon, 27 Mar 2017 12:25:48 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.80.142.22 with HTTP; Mon, 27 Mar 2017 12:25:07 -0700 (PDT)
In-Reply-To: <413A67CD-120A-48A5-8B31-6C229780CF54@gmail.com>
References: <E9764ADA-E7AE-41D2-985C-91426233DE60@gmail.com>
 <CAJLbxRYMzbXmgJmrCorkXA2Jfx5Yq_BSkgWb2DNd=9o3iA+1ag@mail.gmail.com> <413A67CD-120A-48A5-8B31-6C229780CF54@gmail.com>
From: Mike Percy <mpercy@apache.org>
Date: Mon, 27 Mar 2017 12:25:07 -0700
X-Gmail-Original-Message-ID: <CAJLbxRYgsoHw6q_1DcuGOuUids2xstt9g0Kynn02wJ2f38=S7w@mail.gmail.com>
Message-ID: <CAJLbxRYgsoHw6q_1DcuGOuUids2xstt9g0Kynn02wJ2f38=S7w@mail.gmail.com>
Subject: Re: Spark on Kudu Roadmap
To: user@kudu.apache.org
Content-Type: multipart/alternative; boundary=001a1146ed9e7ecf10054bbb4fb0
archived-at: Mon, 27 Mar 2017 19:25:51 -0000

--001a1146ed9e7ecf10054bbb4fb0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hi Ben,
I don't really know so I'll let someone else more familiar with the Spark
integration chime in on that. However I searched the Kudu JIRA and I don't
see a tracking ticket filed on this (the closest thing I could find was
https://issues.apache.org/jira/browse/KUDU-1676 ) so you may want to file a
JIRA to help track this feature.

Mike


On Mon, Mar 27, 2017 at 11:55 AM, Benjamin Kim <bbuild11@gmail.com> wrote:

> Hi Mike,
>
> I believe what we are looking for is this below. It is an often request
> use case.
>
> Anyone know if the Spark package will ever allow for creating tables in
> Spark SQL?
>
> Such as:
>        CREATE EXTERNAL TABLE <table-name>
>        USING org.apache.kudu.spark.kudu
>        OPTIONS (Map("kudu.master" -> =E2=80=9C<kudu-master>", "kudu.table=
" ->
> =E2=80=9Ctable-name=E2=80=9D));
>
> In this way, plain SQL can be used to do DDL, DML statements whether in
> Spark SQL code or using JDBC to interface with Spark SQL Thriftserver.
>
>
> Thanks,
> Ben
>
>
>
> On Mar 27, 2017, at 11:01 AM, Mike Percy <mpercy@apache.org> wrote:
>
> Hi Ben,
> Is there anything in particular you are looking for?
>
> Thanks,
> Mike
>
> On Mon, Mar 27, 2017 at 9:48 AM, Benjamin Kim <bbuild11@gmail.com> wrote:
>
>> Hi,
>>
>> Are there any plans for deeper integration with Spark especially Spark
>> SQL? Is there a roadmap to look at, so I can know what to expect in the
>> future?
>>
>> Cheers,
>> Ben
>
>
>
>

--001a1146ed9e7ecf10054bbb4fb0
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi Ben,<div>I don&#39;t really know so I&#39;ll let someon=
e else more familiar with the Spark integration chime in on that. However I=
 searched the Kudu JIRA and I don&#39;t see a tracking ticket filed on this=
 (the closest thing I could find was=C2=A0<a href=3D"https://issues.apache.=
org/jira/browse/KUDU-1676">https://issues.apache.org/jira/browse/KUDU-1676<=
/a> ) so you may want to file a JIRA to help track this feature.</div><div>=
<br></div><div>Mike</div><div><br></div></div><div class=3D"gmail_extra"><b=
r><div class=3D"gmail_quote">On Mon, Mar 27, 2017 at 11:55 AM, Benjamin Kim=
 <span dir=3D"ltr">&lt;<a href=3D"mailto:bbuild11@gmail.com" target=3D"_bla=
nk">bbuild11@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_=
quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1=
ex"><div style=3D"word-wrap:break-word">Hi Mike,<div><br></div><div>I belie=
ve what we are looking for is this below. It is an often request use case.<=
/div><div><br></div><blockquote style=3D"margin:0 0 0 40px;border:none;padd=
ing:0px"><div><div>Anyone know if the Spark package will ever allow for cre=
ating tables in Spark SQL?</div><div><br></div><div>Such as:</div><div>=C2=
=A0 =C2=A0 =C2=A0 =C2=A0CREATE EXTERNAL TABLE &lt;table-name&gt;</div><div>=
=C2=A0 =C2=A0 =C2=A0 =C2=A0USING org.apache.kudu.spark.kudu</div><div>=C2=
=A0 =C2=A0 =C2=A0 =C2=A0OPTIONS (Map(&quot;kudu.master&quot; -&gt; =E2=80=
=9C&lt;kudu-master&gt;&quot;, &quot;kudu.table&quot; -&gt; =E2=80=9Ctable-n=
ame=E2=80=9D));</div><div><br></div><div>In this way, plain SQL can be used=
 to do DDL, DML statements whether in Spark SQL code or using JDBC to inter=
face with Spark SQL Thriftserver.</div></div></blockquote><div><br></div>Th=
anks,<div>Ben<div><div class=3D"h5"><br><div><br></div><div><br><div><block=
quote type=3D"cite"><div>On Mar 27, 2017, at 11:01 AM, Mike Percy &lt;<a hr=
ef=3D"mailto:mpercy@apache.org" target=3D"_blank">mpercy@apache.org</a>&gt;=
 wrote:</div><br class=3D"m_-2984439151967905717Apple-interchange-newline">=
<div><div dir=3D"ltr">Hi Ben,<div>Is there anything in particular you are l=
ooking for?</div><div><br></div><div>Thanks,</div><div>Mike</div></div><div=
 class=3D"gmail_extra"><br><div class=3D"gmail_quote">On Mon, Mar 27, 2017 =
at 9:48 AM, Benjamin Kim <span dir=3D"ltr">&lt;<a href=3D"mailto:bbuild11@g=
mail.com" target=3D"_blank">bbuild11@gmail.com</a>&gt;</span> wrote:<br><bl=
ockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #=
ccc solid;padding-left:1ex">Hi,<br>
<br>
Are there any plans for deeper integration with Spark especially Spark SQL?=
 Is there a roadmap to look at, so I can know what to expect in the future?=
<br>
<br>
Cheers,<br>
Ben</blockquote></div><br></div>
</div></blockquote></div><br></div></div></div></div></div></blockquote></d=
iv><br></div>

--001a1146ed9e7ecf10054bbb4fb0--