beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Julian Hyde (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (BEAM-301) Add a Beam SQL DSL
Date Wed, 05 Apr 2017 22:47:41 GMT

    [ https://issues.apache.org/jira/browse/BEAM-301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15957945#comment-15957945
] 

Julian Hyde edited comment on BEAM-301 at 4/5/17 10:47 PM:
-----------------------------------------------------------

A couple of recent developments in Calcite's streaming SQL:
* A proposed {{EMIT}} clause to match Beam's "triggering" (the term "trigger" has some unfortunate
connotations in the SQL world). Appears on slide 15 of [my "Streaming SQL" talk at FlinkForward
2016|https://www.slideshare.net/julianhyde/streaming-sql-at-flinkforward-berlin-20160912].
* A {{MATCH_RECOGNIZE}} clause, inspired by Oracle, good for non-streaming and streaming queries,
but clearly good for "Complex Event Processing" (CEP) kinds of applications. Currently we
have parser and validator support but no implementation; see CALCITE-1570.


was (Author: julianhyde):
A couple of recent developments in Calcite's streaming SQL:
* A proposed {{EMIT}} clause to match Beam's "triggering" (the term "trigger" has some unfortunate
connotations in the SQL world). Appears on slide 15 of [https://www.slideshare.net/julianhyde/streaming-sql-at-flinkforward-berlin-20160912|my
"Streaming SQL" talk at FlinkForward].
* A {{MATCH_RECOGNIZE}} clause, inspired by Oracle, good for non-streaming and streaming queries,
but clearly good for "Complex Event Processing" (CEP) kinds of applications. Currently we
have parser and validator support but no implementation; see CALCITE-1570.

> Add a Beam SQL DSL
> ------------------
>
>                 Key: BEAM-301
>                 URL: https://issues.apache.org/jira/browse/BEAM-301
>             Project: Beam
>          Issue Type: New Feature
>          Components: sdk-ideas
>            Reporter: Jean-Baptiste Onofré
>            Assignee: Xu Mingmin
>
> The SQL DSL helps developers to build a Beam pipeline from SQL statement in String directly.

> In Phase I, it starts to support INSERT/SELECT queries with FILTERs, one example SQL
as below:
> {code}
> INSERT INTO `SUB_USEREVENT` (`SITEID`, `PAGEID`, `PAGENAME`, `EVENTTIMESTAMP`)
> (SELECT STREAM `USEREVENT`.`SITEID`, `USEREVENT`.`PAGEID`, `USEREVENT`.`PAGENAME`, `USEREVENT`.`EVENTTIMESTAMP`
> FROM `USEREVENT` AS `USEREVENT`
> WHERE `USEREVENT`.`SITEID` > 10)
> {code}
> A design doc is available at https://docs.google.com/document/d/1Uc5xYTpO9qsLXtT38OfuoqSLimH_0a1Bz5BsCROMzCU/edit?usp=sharing.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message