spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Reynold Xin <r...@databricks.com>
Subject [discuss] SPIP: Continuous Processing Mode for Structured Streaming
Date Mon, 23 Oct 2017 22:11:01 GMT
Please take a look at the attached PDF for the SPIP: Continuous Processing
Mode for Structured Streaming

https://issues.apache.org/jira/browse/SPARK-20928

It is meant to be a very small, surgical change to Structured Streaming to
enable ultra-low latency. This is great timing because we are also
designing and implementing data source API v2. If designed properly, we can
have the same data source API working for both streaming and batch.

Mime
View raw message