beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mingwei Samuel (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BEAM-3017) DropInputs on every Sink, Breaking Transform Flow
Date Thu, 05 Oct 2017 00:21:00 GMT
Mingwei Samuel created BEAM-3017:
------------------------------------

             Summary: DropInputs on every Sink, Breaking Transform Flow
                 Key: BEAM-3017
                 URL: https://issues.apache.org/jira/browse/BEAM-3017
             Project: Beam
          Issue Type: Bug
          Components: runner-dataflow
    Affects Versions: 2.1.0
            Reporter: Mingwei Samuel
            Assignee: Thomas Groh
            Priority: Minor


After upgrade to version 2.1.0 there are "DropInput##" transforms on every output of my pipeline,
outside of their corresponding transforms. They're getting added to my
{{BigQueryIO.<T>writeTableRows()}}
sinks, even though looking at the source code it appears that these "DropInput" transforms
are supposed to pull from reads that do not have any outputs, so I'm not sure why they're
getting added to sinks.

These transforms are flooding my graph and filling it with junk, for example: !https://i.imgur.com/jXtn9Gr.png!



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message