flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From tillrohrmann <...@git.apache.org>
Subject [GitHub] flink pull request: [FLINK-2631] [streaming] Fixes the StreamFold ...
Date Mon, 07 Sep 2015 15:12:45 GMT
GitHub user tillrohrmann opened a pull request:

    https://github.com/apache/flink/pull/1101

    [FLINK-2631] [streaming] Fixes the StreamFold operator and adds output type configurable
stream operators

    Adds support for non-serializable initial fold values by storing the value in a byte array
before shipping it. The shipped initial fold value is deserialized on the TM while calling
the `open` method.
    
    Furthermore, this PR introduces the `OutputTypeConfigurable` interface which allows stream
operators to get to know their output type. The `OutputTypeConfigurable` interface offers
the method `setOutputType` which is called by the `StreamGraph` when the `StreamOperator`
is added in the `addOperator` method. At the latest at this moment, the concrete output type,
whether inferred from the UDF or set manually with `returns`, should be know to the system,
because also the input and output type serializers for the vertex are created in the `addOperator`
method. All stream operators which need to know their output type should implement the `OutputTypeConfigurable`
interface.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/tillrohrmann/flink fixStreamingFold

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flink/pull/1101.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1101
    
----
commit 63951adca0e8bfefd1d81b933017e9fadc5f556f
Author: Till Rohrmann <trohrmann@apache.org>
Date:   2015-09-07T09:34:48Z

    [FLINK-2631] [streaming] Fixes the StreamFold operator. Adds OutputTypeConfigurable interface
to support type injection at StreamGraph creation.
    
    Adds test for non serializable fold type. Adds test to verify proper output type forwarding
for OutputTypeConfigurable implementations.
    
    Adds comments

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

Mime
View raw message