flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-4460) Side Outputs in Flink
Date Sat, 10 Dec 2016 01:51:58 GMT

    [ https://issues.apache.org/jira/browse/FLINK-4460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15736976#comment-15736976

ASF GitHub Bot commented on FLINK-4460:

GitHub user chenqin opened a pull request:


    [FLINK-4460] Side Outputs in Flink

Expose sideOutput with `OutputTag<T>`, 
    For those userFunction provide `Collector<OUT> collector` as a parameter, 
     - it offer a util class`CollectorWrapper<OUT> wrapper = new CollectorWrapper<OUT>(collector);`
which can write sideOutput element `wrapper.collect(OutputTag<SIDEOUT> tag, sideout)`
as well as `getSideOutput(OutputTag<SIDEOUT> tag)` in `singleStreamOutputOpeator` and
get sideOutput DataStream<SIDEOUT>.
     - each OutputTag with same type can have different value, getSideOutput will only expose
element with exact same OutputTag type and value. 
    sideOutput Late arriving event if
    - time characteristic set to eventTime
    - all assigned window(s) isLate return(s) true 
    - event timestamp no later than currentWatermark+ allowedLateness)

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/chenqin/flink flip

Alternatively you can review and apply these changes as the patch at:


To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #2982
commit de674f19fcbe9955cb4208ef0938fe5b0f7adc90
Author: Chen Qin <qinnchen@fgmail.com>
Date:   2016-10-21T19:38:04Z

    allow mutpile output stream

commit 3d91e6c69dbfbcb2c73dcc37ac2d8ed637a374eb
Author: Chen Qin <cq@uber.com>
Date:   2016-11-29T21:24:09Z

    Merge branch 'master' into flip

commit 977b2d7fc54e1f9663a5ceb8a62ed2af5a955ca6
Author: Chen Qin <cq@uber.com>
Date:   2016-12-01T22:19:56Z

    allow mutiple OutputTag with same type
    implement windowopeator late arriving events
    add unit/integration tests


> Side Outputs in Flink
> ---------------------
>                 Key: FLINK-4460
>                 URL: https://issues.apache.org/jira/browse/FLINK-4460
>             Project: Flink
>          Issue Type: New Feature
>          Components: Core, DataStream API
>    Affects Versions: 1.2.0, 1.1.3
>            Reporter: Chen Qin
>              Labels: latearrivingevents, sideoutput
> https://docs.google.com/document/d/1vg1gpR8JL4dM07Yu4NyerQhhVvBlde5qdqnuJv4LcV4/edit?usp=sharing

This message was sent by Atlassian JIRA

View raw message