flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-4460) Side Outputs in Flink
Date Sat, 10 Dec 2016 01:51:58 GMT

    [ https://issues.apache.org/jira/browse/FLINK-4460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15736976#comment-15736976
] 

ASF GitHub Bot commented on FLINK-4460:
---------------------------------------

GitHub user chenqin opened a pull request:

    https://github.com/apache/flink/pull/2982

    [FLINK-4460] Side Outputs in Flink

    [FLIP-13](https://cwiki.apache.org/confluence/display/FLINK/FLIP-13+Side+Outputs+in+Flink)
Expose sideOutput with `OutputTag<T>`, 
    
    For those userFunction provide `Collector<OUT> collector` as a parameter, 
     - it offer a util class`CollectorWrapper<OUT> wrapper = new CollectorWrapper<OUT>(collector);`
which can write sideOutput element `wrapper.collect(OutputTag<SIDEOUT> tag, sideout)`
as well as `getSideOutput(OutputTag<SIDEOUT> tag)` in `singleStreamOutputOpeator` and
get sideOutput DataStream<SIDEOUT>.
     - each OutputTag with same type can have different value, getSideOutput will only expose
element with exact same OutputTag type and value. 
    
    sideOutput Late arriving event if
    - time characteristic set to eventTime
    - all assigned window(s) isLate return(s) true 
    - event timestamp no later than currentWatermark+ allowedLateness)

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/chenqin/flink flip

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flink/pull/2982.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #2982
    
----
commit de674f19fcbe9955cb4208ef0938fe5b0f7adc90
Author: Chen Qin <qinnchen@fgmail.com>
Date:   2016-10-21T19:38:04Z

    allow mutpile output stream

commit 3d91e6c69dbfbcb2c73dcc37ac2d8ed637a374eb
Author: Chen Qin <cq@uber.com>
Date:   2016-11-29T21:24:09Z

    Merge branch 'master' into flip

commit 977b2d7fc54e1f9663a5ceb8a62ed2af5a955ca6
Author: Chen Qin <cq@uber.com>
Date:   2016-12-01T22:19:56Z

    allow mutiple OutputTag with same type
    implement windowopeator late arriving events
    add unit/integration tests

----


> Side Outputs in Flink
> ---------------------
>
>                 Key: FLINK-4460
>                 URL: https://issues.apache.org/jira/browse/FLINK-4460
>             Project: Flink
>          Issue Type: New Feature
>          Components: Core, DataStream API
>    Affects Versions: 1.2.0, 1.1.3
>            Reporter: Chen Qin
>              Labels: latearrivingevents, sideoutput
>
> https://docs.google.com/document/d/1vg1gpR8JL4dM07Yu4NyerQhhVvBlde5qdqnuJv4LcV4/edit?usp=sharing



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message