Mailing-List: contact dev-help@spark.apache.org; run by ezmlm
Precedence: bulk
MIME-Version: 1.0
References: <CAEQOfPMLHtB7W=nwyqq8c1StY9NA6oyPiNvcro92koGLzjAyxA@mail.gmail.com>
 <CAEQOfPM81oBVTix3HtC-iih_YW=ZXerCcHAjT6xraxawvS9tfg@mail.gmail.com>
In-Reply-To: <CAEQOfPM81oBVTix3HtC-iih_YW=ZXerCcHAjT6xraxawvS9tfg@mail.gmail.com>
From: Russell Spitzer <russell.spitzer@gmail.com>
Date: Thu, 17 Aug 2017 13:12:26 +0000
Message-ID: <CAB4LabQAxeK1o4o2srhBXaLDm2rp-HEAzM_Ytm3W7zmxk8T5Kw@mail.gmail.com>
Subject: Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2
To: Wenchen Fan <cloud0fan@gmail.com>, Spark dev list <dev@spark.apache.org>
Content-Type: multipart/alternative; boundary="001a113fe99639ebc30556f2c483"
archived-at: Thu, 17 Aug 2017 13:12:43 -0000

--001a113fe99639ebc30556f2c483
Content-Type: text/plain; charset="UTF-8"

-1, I don't think there has really been any discussion of this api change
yet or at least it hasn't occurred on the jira ticket

On Thu, Aug 17, 2017 at 8:05 AM Wenchen Fan <cloud0fan@gmail.com> wrote:

> adding my own +1 (binding)
>
> On Thu, Aug 17, 2017 at 9:02 PM, Wenchen Fan <cloud0fan@gmail.com> wrote:
>
>> Hi all,
>>
>> Following the SPIP process, I'm putting this SPIP up for a vote.
>>
>> The current data source API doesn't work well because of some limitations
>> like: no partitioning/bucketing support, no columnar read, hard to support
>> more operator push down, etc.
>>
>> I'm proposing a Data Source API V2 to address these problems, please read
>> the full document at
>> https://issues.apache.org/jira/secure/attachment/12882332/SPIP%20Data%20Source%20API%20V2.pdf
>>
>> Since this SPIP is mostly about APIs, I also created a prototype and put
>> java docs on these interfaces, so that it's easier to review these
>> interfaces and discuss: https://github.com/cloud-fan/spark/pull/10/files
>>
>> The vote will be up for the next 72 hours. Please reply with your vote:
>>
>> +1: Yeah, let's go forward and implement the SPIP.
>> +0: Don't really care.
>> -1: I don't think this is a good idea because of the following
>> technical reasons.
>>
>> Thanks!
>>
>
>

--001a113fe99639ebc30556f2c483
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">-1, I don&#39;t think there has really been any discussion=
 of this api change yet or at least it hasn&#39;t occurred on the jira tick=
et</div><br><div class=3D"gmail_quote"><div dir=3D"ltr">On Thu, Aug 17, 201=
7 at 8:05 AM Wenchen Fan &lt;<a href=3D"mailto:cloud0fan@gmail.com">cloud0f=
an@gmail.com</a>&gt; wrote:<br></div><blockquote class=3D"gmail_quote" styl=
e=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div di=
r=3D"ltr">adding my own +1 (binding)</div><div class=3D"gmail_extra"><br><d=
iv class=3D"gmail_quote">On Thu, Aug 17, 2017 at 9:02 PM, Wenchen Fan <span=
 dir=3D"ltr">&lt;<a href=3D"mailto:cloud0fan@gmail.com" target=3D"_blank">c=
loud0fan@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quot=
e" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">=
<div dir=3D"ltr">Hi all,<div><br></div><div>Following the SPIP process, I&#=
39;m putting this SPIP up for a vote.</div><div><br></div><div>The current =
data source API doesn&#39;t work well because of some limitations like: no =
partitioning/bucketing support, no columnar read, hard to support more oper=
ator push down, etc.</div><div><br></div><div>I&#39;m proposing a Data Sour=
ce API V2 to address these problems, please read the full document at <a hr=
ef=3D"https://issues.apache.org/jira/secure/attachment/12882332/SPIP%20Data=
%20Source%20API%20V2.pdf" target=3D"_blank">https://issues.apache.org/jira/=
secure/attachment/12882332/SPIP%20Data%20Source%20API%20V2.pdf</a></div><di=
v><br></div><div>Since this SPIP is mostly about APIs, I also created a pro=
totype and put java docs on these interfaces, so that it&#39;s easier to re=
view these interfaces and discuss:=C2=A0<a href=3D"https://github.com/cloud=
-fan/spark/pull/10/files" target=3D"_blank">https://github.com/cloud-fan/sp=
ark/pull/10/files</a></div><div><br></div><div><div>The vote will be up for=
 the next 72 hours. Please reply with your vote:</div><div><br></div><div>+=
1: Yeah, let&#39;s go forward and implement the SPIP.</div><div>+0: Don&#39=
;t really care.</div><div>-1: I don&#39;t think this is a good idea because=
 of the following</div><div>technical reasons.</div><div><br></div><div>Tha=
nks!</div></div></div>
</blockquote></div><br></div>
</blockquote></div>

--001a113fe99639ebc30556f2c483--