Mailing-List: contact user-help@spark.apache.org; run by ezmlm
Precedence: bulk
MIME-Version: 1.0
In-Reply-To: <CAAswR-5auuBiCKUR=xdBoR6yujBDFdPgfFn4Gd2fkTRGuxvgwQ@mail.gmail.com>
References: <1465427539908-27120.post@n3.nabble.com> <CAAswR-5auuBiCKUR=xdBoR6yujBDFdPgfFn4Gd2fkTRGuxvgwQ@mail.gmail.com>
From: Chang Lim <changlim@gmail.com>
Date: Thu, 9 Jun 2016 22:30:20 -0700
Message-ID: <CANRkBkrVX-wbTuYsqdte6ujrn0X5imTF_RQt7C4yrDJjcbOCyA@mail.gmail.com>
Subject: Re: Spark 2.0 Streaming and Event Time
To: Michael Armbrust <michael@databricks.com>
Cc: user <user@spark.apache.org>
Content-Type: multipart/alternative; boundary=001a113dc862ad908e0534e5d515
archived-at: Fri, 10 Jun 2016 05:30:27 -0000

--001a113dc862ad908e0534e5d515
Content-Type: text/plain; charset=UTF-8

Yes, now I realized that.  I did exchanged emails with TD on this topic.
The Microsoft presentation at Spark summit ("reorder" function) would be a
good addition to Spark.  Would this feature be on the road map?

On Thu, Jun 9, 2016 at 9:56 AM, Michael Armbrust <michael@databricks.com>
wrote:

> There is no special setting for event time (though we will be adding one
> for setting a watermark in 2.1 to allow us to reduce the amount of state
> that needs to be kept around).  Just window/groupBy on the on the column
> that is your event time.
>
> On Wed, Jun 8, 2016 at 4:12 PM, Chang Lim <changlim@gmail.com> wrote:
>
>> Hi All,
>>
>> Does Spark 2.0 Streaming [sqlContext.read.format(...).stream(...)] support
>> Event Time?  In TD's Spark Summit talk yesterday, this is listed as a 2.0
>> feature.  Of so, where is the API or how to set it?
>>
>> Thanks in advanced,
>> Chang
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-2-0-Streaming-and-Event-Time-tp27120.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>>
>>
>

--001a113dc862ad908e0534e5d515
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Yes, now I realized that.=C2=A0 I did exchanged emails wit=
h TD on this topic.=C2=A0 The Microsoft presentation at Spark summit (&quot=
;reorder&quot; function) would be a good addition to Spark.=C2=A0 Would thi=
s feature be on the road map?</div><div class=3D"gmail_extra"><br><div clas=
s=3D"gmail_quote">On Thu, Jun 9, 2016 at 9:56 AM, Michael Armbrust <span di=
r=3D"ltr">&lt;<a href=3D"mailto:michael@databricks.com" target=3D"_blank">m=
ichael@databricks.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_q=
uote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1e=
x"><div dir=3D"ltr">There is no special setting for event time (though we w=
ill be adding one for setting a watermark in 2.1 to allow us to reduce the =
amount of state that needs to be kept around).=C2=A0 Just window/groupBy on=
 the on the column that is your event time.</div><div class=3D"gmail_extra"=
><br><div class=3D"gmail_quote"><span class=3D"">On Wed, Jun 8, 2016 at 4:1=
2 PM, Chang Lim <span dir=3D"ltr">&lt;<a href=3D"mailto:changlim@gmail.com"=
 target=3D"_blank">changlim@gmail.com</a>&gt;</span> wrote:<br></span><bloc=
kquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #cc=
c solid;padding-left:1ex"><span class=3D"">Hi All,<br>
<br>
Does Spark 2.0 Streaming [sqlContext.read.format(...).stream(...)] support<=
br>
Event Time?=C2=A0 In TD&#39;s Spark Summit talk yesterday, this is listed a=
s a 2.0<br>
feature.=C2=A0 Of so, where is the API or how to set it?<br>
<br>
Thanks in advanced,<br>
Chang<br>
<br>
<br>
<br></span><span class=3D"">
--<br>
View this message in context: <a href=3D"http://apache-spark-user-list.1001=
560.n3.nabble.com/Spark-2-0-Streaming-and-Event-Time-tp27120.html" rel=3D"n=
oreferrer" target=3D"_blank">http://apache-spark-user-list.1001560.n3.nabbl=
e.com/Spark-2-0-Streaming-and-Event-Time-tp27120.html</a><br>
Sent from the Apache Spark User List mailing list archive at Nabble.com.<br=
>
<br>
---------------------------------------------------------------------<br>
To unsubscribe, e-mail: <a href=3D"mailto:user-unsubscribe@spark.apache.org=
" target=3D"_blank">user-unsubscribe@spark.apache.org</a><br>
For additional commands, e-mail: <a href=3D"mailto:user-help@spark.apache.o=
rg" target=3D"_blank">user-help@spark.apache.org</a><br>
<br>
</span></blockquote></div><br></div>
</blockquote></div><br></div>

--001a113dc862ad908e0534e5d515--