gearpump-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GEARPUMP-217) Add SQL support
Date Sat, 19 Aug 2017 09:22:02 GMT

    [ https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16134034#comment-16134034
] 

ASF GitHub Bot commented on GEARPUMP-217:
-----------------------------------------

GitHub user manuzhang opened a pull request:

    https://github.com/apache/incubator-gearpump/pull/218

    [GEARPUMP-217] Merge master into sql branch

    Be sure to do all of the following to help us incorporate your contribution
    quickly and easily:
    
     - [ ] Make sure the commit message is formatted like:
       `[GEARPUMP-<Jira issue #>] Meaningful description of pull request` 
     - [ ] Make sure tests pass via `sbt clean test`.
     - [ ] Make sure old documentation affected by the pull request has been updated and new
documentation added for new functionality. 
    


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/manuzhang/incubator-gearpump sync_master

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-gearpump/pull/218.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #218
    
----
commit a9755cbec0426a3e11504640e87a2970071854a9
Author: manuzhang <owenzhang1990@gmail.com>
Date:   2017-07-14T05:26:27Z

    Bump up version to 0.8.5-SNAPSHOT
    
    Author: manuzhang <owenzhang1990@gmail.com>
    
    Closes #193 from manuzhang/bump_up_version.

commit e3c63ef2b51af6a6c4d97c91479b7c1f6082c0fe
Author: manuzhang <owenzhang1990@gmail.com>
Date:   2017-07-17T08:02:09Z

    [GEARPUMP-325] Fix license issues
    
    Author: manuzhang <owenzhang1990@gmail.com>
    
    Closes #194 from manuzhang/fix_licenses.

commit 05f68bc55aad8e56c0587995fce84fd471823bc1
Author: huafengw <fvunicorn@gmail.com>
Date:   2017-07-20T08:34:50Z

    [GEARPUMP-322] Fix multiple SLF4J bindings on classpath
    
    Author: huafengw <fvunicorn@gmail.com>
    
    Closes #196 from huafengw/fix322.

commit 50316ce31db34785c4af8261dd66d8a1740a5601
Author: manuzhang <owenzhang1990@gmail.com>
Date:   2017-07-21T01:42:59Z

    [GEARPUMP-327] Put jarstore and logs under "gearpump.home"
    
    Author: manuzhang <owenzhang1990@gmail.com>
    
    Closes #197 from manuzhang/fix_jarstore_logs.

commit a47e1a6dbe2ab594a891f48b2bb4f32b613f1b22
Author: darionyaphet <darion.yaphet@gmail.com>
Date:   2017-07-25T05:23:14Z

    [GEARPUMP-328] FetchThread fetchSleepMS from Int to Long
    
    currently *KafkaConfig.FETCH_SLEEP_MS_CONFIG* is a INT parameter , move it into a LONG
parameter is better .
    
    Author: darionyaphet <darion.yaphet@gmail.com>
    
    Closes #199 from darionyaphet/GEARPUMP-328.

commit ac8ac039217725f9f924ec901fdf7adfd9f51657
Author: manuzhang <owenzhang1990@gmail.com>
Date:   2017-07-26T02:28:25Z

    [GEARPUMP-330] Allow examples to run in `sbt run` and Intellij
    
    Author: manuzhang <owenzhang1990@gmail.com>
    
    Closes #200 from manuzhang/run_examples_in_ide.

commit fa3f892d76ca932fae44587f7860030b32f401bf
Author: huafengw <fvunicorn@gmail.com>
Date:   2017-07-31T06:36:38Z

    [GEARPUMP-331] Allow applications to be run in IDE
    
    Author: huafengw <fvunicorn@gmail.com>
    
    Closes #202 from huafengw/GP331.

commit 0f5f7221ea7ff01e4e2c0d6ee4f7f95b537f5298
Author: manuzhang <owenzhang1990@gmail.com>
Date:   2017-08-02T06:20:55Z

    [GEARPUMP-333] Fix examples assembling
    
    Author: manuzhang <owenzhang1990@gmail.com>
    
    Closes #203 from manuzhang/fix_example_dep.

commit 4ad0ec42819d81adeac57b13b772b023a8746aac
Author: manuzhang <owenzhang1990@gmail.com>
Date:   2017-08-02T09:53:15Z

    [GEARPUMP-334] Fix Java WordCount DSL example
    
    Author: manuzhang <owenzhang1990@gmail.com>
    
    Closes #204 from manuzhang/fix_wc_java_dsl.

commit db3e8bd1eaa3a0a89c1e544ac26dae65ecd57908
Author: manuzhang <owenzhang1990@gmail.com>
Date:   2017-08-02T10:10:46Z

    [GEARPUMP-335] Set kafka tests log level to ERROR
    
    Author: manuzhang <owenzhang1990@gmail.com>
    
    Closes #205 from manuzhang/reduce_logs.

commit b6f5ccd6ed0bb70d878c1f786da637ac4597a84f
Author: manuzhang <owenzhang1990@gmail.com>
Date:   2017-08-03T12:17:52Z

    [GEARPUMP-336] Add scalac options and fix warnings
    
    Author: manuzhang <owenzhang1990@gmail.com>
    
    Closes #207 from manuzhang/fix_warnings.

commit f96aca995d6acd0770529a39fb25a4c4ef18c31e
Author: manuzhang <owenzhang1990@gmail.com>
Date:   2017-08-04T02:11:58Z

    [GEARPUMP-338] Improve time related types and constants
    
    Author: manuzhang <owenzhang1990@gmail.com>
    
    Closes #208 from manuzhang/fix_time.

commit e1228a31445418e6aca77ad3cf4c2c18fb6748ee
Author: manuzhang <owenzhang1990@gmail.com>
Date:   2017-08-06T22:02:29Z

    [GEARPUMP-339] Add ScalaDoc to Streaming DSL
    
    Author: manuzhang <owenzhang1990@gmail.com>
    
    Closes #212 from manuzhang/plan_doc.

commit c1801595df62eff8bd8d1b3e51e94aa130fb686f
Author: manuzhang <owenzhang1990@gmail.com>
Date:   2017-08-14T04:07:06Z

    [GEARPUMP-339] Add ScalaDoc to window api and impl
    
    Author: manuzhang <owenzhang1990@gmail.com>
    
    Closes #213 from manuzhang/add_window_doc.

commit 38fe7ec0040299c5669a5e1c654bd5c61eb5c5bb
Author: manuzhang <owenzhang1990@gmail.com>
Date:   2017-08-16T22:34:10Z

    [GEARPUMP-341] Update processing watermark in DataSinkTask
    
    Author: manuzhang <owenzhang1990@gmail.com>
    
    Closes #214 from manuzhang/fix_datasinktask.

commit f75fb19c78ff7e04bfdb9727bd8bf6e08bc4d1e8
Author: huafengw <fvunicorn@gmail.com>
Date:   2017-08-17T14:45:39Z

    [GEARPUMP-343] Fix typo of EmbeddedRuntimeEnvironment
    
    Author: huafengw <fvunicorn@gmail.com>
    
    Closes #215 from huafengw/minor.

commit 0b4377a1525d90f9c1ec3857f784bad08e1d616b
Author: manuzhang <owenzhang1990@gmail.com>
Date:   2017-08-19T09:19:18Z

    [GEARPUMP-217] Merge master into sql branch

----


> Add SQL support 
> ----------------
>
>                 Key: GEARPUMP-217
>                 URL: https://issues.apache.org/jira/browse/GEARPUMP-217
>             Project: Apache Gearpump
>          Issue Type: New Feature
>          Components: streaming
>    Affects Versions: 0.8.1
>            Reporter: Manu Zhang
>            Assignee: Buddhi Ayesha
>              Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I propose to
build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical plan and
optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and Apache Samza
all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite (check reference
1 and 2). Please checkout reference 3 for an example implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message