spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chang Lim <chang...@gmail.com>
Subject Re: Spark 2.0 Streaming and Event Time
Date Fri, 10 Jun 2016 05:30:20 GMT
Yes, now I realized that.  I did exchanged emails with TD on this topic.
The Microsoft presentation at Spark summit ("reorder" function) would be a
good addition to Spark.  Would this feature be on the road map?

On Thu, Jun 9, 2016 at 9:56 AM, Michael Armbrust <michael@databricks.com>
wrote:

> There is no special setting for event time (though we will be adding one
> for setting a watermark in 2.1 to allow us to reduce the amount of state
> that needs to be kept around).  Just window/groupBy on the on the column
> that is your event time.
>
> On Wed, Jun 8, 2016 at 4:12 PM, Chang Lim <changlim@gmail.com> wrote:
>
>> Hi All,
>>
>> Does Spark 2.0 Streaming [sqlContext.read.format(...).stream(...)] support
>> Event Time?  In TD's Spark Summit talk yesterday, this is listed as a 2.0
>> feature.  Of so, where is the API or how to set it?
>>
>> Thanks in advanced,
>> Chang
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-2-0-Streaming-and-Event-Time-tp27120.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>>
>>
>

Mime
View raw message