beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-270) Support Timestamps/Windows in Flink Batch
Date Mon, 30 May 2016 12:46:12 GMT

    [ https://issues.apache.org/jira/browse/BEAM-270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15306607#comment-15306607
] 

ASF GitHub Bot commented on BEAM-270:
-------------------------------------

GitHub user mxm opened a pull request:

    https://github.com/apache/incubator-beam/pull/398

    [BEAM-270] remove CoGroupByKey translation artifacts

    We used to have an optimization for the CoGroupByKey operation with two
    inputs. This is no longer the cases after changes to the batch execution
    in BEAM-270.
    
    CC @aljoscha

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/mxm/incubator-beam BEAM-270

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-beam/pull/398.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #398
    
----
commit 9706438e3a1988c05ab16f9c14912af958ef875a
Author: Maximilian Michels <mxm@apache.org>
Date:   2016-05-30T12:42:57Z

    [BEAM-270] remove CoGroupByKey translation artifacts
    
    We used to have an optimization for the CoGroupByKey operation with two
    inputs. This is no longer the cases after changes to the batch execution
    in BEAM-270.

----


> Support Timestamps/Windows in Flink Batch
> -----------------------------------------
>
>                 Key: BEAM-270
>                 URL: https://issues.apache.org/jira/browse/BEAM-270
>             Project: Beam
>          Issue Type: Sub-task
>          Components: runner-flink
>            Reporter: Aljoscha Krettek
>            Assignee: Aljoscha Krettek
>             Fix For: 0.1.0-incubating
>
>
> Right now, Flink Batch execution does not use {{WindowedValue}} internally, this means
that all programs that interact with timestamps/windows will not work. We should just internally
wrap everything in {{WindowedValue}} as we do in Flink Streaming. This also makes it very
straightforward to add support for windows.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message