spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sandy Ryza <sandy.r...@cloudera.com>
Subject Re: Info about Dataset
Date Tue, 03 Nov 2015 21:42:07 GMT
Hi Justin,

The Dataset API proposal is available here:
https://issues.apache.org/jira/browse/SPARK-9999.

-Sandy

On Tue, Nov 3, 2015 at 1:41 PM, Justin Uang <justin.uang@gmail.com> wrote:

> Hi,
>
> I was looking through some of the PRs slated for 1.6.0 and I noted
> something called a Dataset, which looks like a new concept based off of the
> scaladoc for the class. Can anyone point me to some references/design_docs
> regarding the choice to introduce the new concept? I presume it is probably
> something to do with performance optimizations?
>
> Thanks!
>
> Justin
>

Mime
View raw message