beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ahmet Altay (JIRA)" <>
Subject [jira] [Updated] (BEAM-2007) DataflowRunner drops Reads with no consumers
Date Wed, 19 Apr 2017 22:04:41 GMT


Ahmet Altay updated BEAM-2007:
    Fix Version/s:     (was: First stable release)

> DataflowRunner drops Reads with no consumers
> --------------------------------------------
>                 Key: BEAM-2007
>                 URL:
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-dataflow, sdk-py
>            Reporter: Daniel Halperin
>            Assignee: Ahmet Altay
> Basically, if a pipeline has "just" a Read with no consumers, the optimizer in Dataflow
will drop it. To preserve Beam semantics, we do want to run the Read and drop its output,
e.g., because the Read may have side effects that we're testing for.
> Is it possible with pipeline surgery to find such Reads and add an Identity ParDo to

This message was sent by Atlassian JIRA

View raw message