flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From chenqin <...@git.apache.org>
Subject [GitHub] flink pull request #2982: [FLINK-4460] Side Outputs in Flink
Date Sat, 10 Dec 2016 01:51:11 GMT
GitHub user chenqin opened a pull request:

    https://github.com/apache/flink/pull/2982

    [FLINK-4460] Side Outputs in Flink

    [FLIP-13](https://cwiki.apache.org/confluence/display/FLINK/FLIP-13+Side+Outputs+in+Flink)
Expose sideOutput with `OutputTag<T>`, 
    
    For those userFunction provide `Collector<OUT> collector` as a parameter, 
     - it offer a util class`CollectorWrapper<OUT> wrapper = new CollectorWrapper<OUT>(collector);`
which can write sideOutput element `wrapper.collect(OutputTag<SIDEOUT> tag, sideout)`
as well as `getSideOutput(OutputTag<SIDEOUT> tag)` in `singleStreamOutputOpeator` and
get sideOutput DataStream<SIDEOUT>.
     - each OutputTag with same type can have different value, getSideOutput will only expose
element with exact same OutputTag type and value. 
    
    sideOutput Late arriving event if
    - time characteristic set to eventTime
    - all assigned window(s) isLate return(s) true 
    - event timestamp no later than currentWatermark+ allowedLateness)

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/chenqin/flink flip

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flink/pull/2982.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #2982
    
----
commit de674f19fcbe9955cb4208ef0938fe5b0f7adc90
Author: Chen Qin <qinnchen@fgmail.com>
Date:   2016-10-21T19:38:04Z

    allow mutpile output stream

commit 3d91e6c69dbfbcb2c73dcc37ac2d8ed637a374eb
Author: Chen Qin <cq@uber.com>
Date:   2016-11-29T21:24:09Z

    Merge branch 'master' into flip

commit 977b2d7fc54e1f9663a5ceb8a62ed2af5a955ca6
Author: Chen Qin <cq@uber.com>
Date:   2016-12-01T22:19:56Z

    allow mutiple OutputTag with same type
    implement windowopeator late arriving events
    add unit/integration tests

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

Mime
View raw message