beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Commented] (BEAM-143) Add test for UnboundedSourceWrapper
Date Wed, 23 Mar 2016 15:41:25 GMT


ASF GitHub Bot commented on BEAM-143:

GitHub user mxm opened a pull request:

    [BEAM-143] add test for UnboundedSourceWrapper

    So far the `UnboundedSourceWrapper` has not been tested systematically which led to a
bunch of regression issues. This PR fixes the UnboundedSourceWrapper and adds a test case.
The test case ensures that the wrapper works as expected. In particular, a full integration
test is run to check whether serialization and instantiation of the wrapper works in a cluster

You can merge this pull request into a Git repository by running:

    $ git pull BEAM-143

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #69
commit 8d36d5dcd55b827f23a22f8acdff455a9c21ffa5
Author: Thomas Groh <>
Date:   2016-03-07T21:47:30Z

    Filter Synthetic Methods in PipelineOptionsFactory

commit 25409464a27b1cbb7adffe90aa7e49e3b1bce4cb
Author: Thomas Groh <>
Date:   2016-02-27T01:30:13Z

    Implement InProcessPipelineRunner#run
    Appropriately construct an evaluation context and executor, and start
    the pipeline when run is called.
    Implement InProcessPipelineResult.
    Apply PTransform overrides.

commit 4c21708c574d5d08db6c7bac5fca1ce09780b730
Author: Rafal Wojdyla <>
Date:   2016-03-11T18:39:55Z

    [flink] Add FlinkRunnerRegistrar
    Expose Flink runner and options via AuteService. AuteService will
    at compile time populate META-INF/services so that Dataflow sdk
    can seamlessly pick up FlinkRunner.
    This closes #40.

commit cb3081da383e6de88a04fd5e190ef69849e1f586
Author: Maximilian Michels <>
Date:   2016-03-16T11:03:07Z

    [BEAM-116] change runners artifactId to runners-parent

commit 066e6ce518be869b424aa283967956de8cb0c495
Author: Scott Wegner <>
Date:   2016-03-17T17:22:42Z

    Add DisplayData builder API to SDK
    This allows generating the display data which will be attached to

commit 28e13f2ae73941404ade8ca2c3e64af43fefc85d
Author: Maximilian Michels <>
Date:   2016-03-21T10:36:35Z

    [flink] add test case for Runner registration

commit d1fcc6645837998176dffbc61464046ec17dbb1f
Author: sammcveety <>
Date:   2016-03-22T18:58:19Z

    Allow for the Datastore dependency of this test to be in a different project than the
main project for the job.

commit 63a2d5447b050b2a7e9e8201ec7bcc287849420e
Author: Neville Li <>
Date:   2016-03-22T22:05:51Z

    make BigtableIO#Read#withRowFilter public

commit 73bbb1c523548b34a8b8403785c68094a5995a51
Author: Maximilian Michels <>
Date:   2016-03-23T15:18:04Z

    [BEAM-144] solve reader serialization issue
    Now, we initialize the UnboundedSourceReader at runtime which requires
    us to keep a copy of the PipelineOptions. This should be fine here
    because we are at the lowest point of the execution stack.

commit f491b424483d7c21f4fdc7b21f489762d0ef964b
Author: Maximilian Michels <>
Date:   2016-03-23T15:19:27Z

    [BEAM-143] [flink] add test for UnboundedSourceWrapper
    The test ensures serialization and execution of the wrapper works as


> Add test for UnboundedSourceWrapper
> -----------------------------------
>                 Key: BEAM-143
>                 URL:
>             Project: Beam
>          Issue Type: Test
>          Components: runner-flink
>            Reporter: Maximilian Michels
>            Assignee: Maximilian Michels
> A test case should ensure the wrapper works as expected. In particular, a full integration
test should be run to check whether serialization and instantiation of the wrapper works in
a cluster setup.

This message was sent by Atlassian JIRA

View raw message