flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Fabian Hueske <fhue...@gmail.com>
Subject [DISCUSS] Defining the Semantics of StreamingSQL
Date Tue, 18 Oct 2016 14:43:05 GMT
Hi everybody,

at Flink Forward we had a BOF session about StreamSQL.
After the conference, some folks and I sat down and drafted a proposal for
Flink's StreamSQL semantics.

-->
https://docs.google.com/document/d/1qVVt_16kdaZQ8RTfA_f4konQPW4tnl8THw6rzGUdaqU

The proposal includes:
- A definition for dynamic tables
- How to convert streams into dynamic tables
- How to convert dynamic tables into streams
- How to query dynamic tables
- Which types of queries to support
- How to specify early results, update rate, and late refinements
- How to control the size of the query state
- How to write query results to external systems (Kafka, files, Cassandra,
HBase, ...)
- How to make a query result accessible via Flink's queryable kv-state
- A few examples how StreamSQL queries can be defined

The proposal does not include a workplan or task breakdown yet.
This is something I'll work on in the next days.

Please share your thoughts and opinions about the proposal on the mailing
list.

Thanks,
Fabian

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message