beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhaozhi QIan (JIRA)" <>
Subject [jira] [Created] (BEAM-3844) Trigger example in the cookbook failed to run on Dataflow
Date Tue, 13 Mar 2018 16:54:00 GMT
Zhaozhi QIan created BEAM-3844:

             Summary: Trigger example in the cookbook failed to run on Dataflow
                 Key: BEAM-3844
             Project: Beam
          Issue Type: Bug
          Components: examples-java
    Affects Versions: 2.3.0
            Reporter: Zhaozhi QIan
            Assignee: Reuven Lax

The example org.apache.beam.examples.cookbook.TriggerExample failed to run on Dataflow. Big
query returns failure code 409 indicating it's trying to write to an non-empty table but WriteDisposition
is set to WRITE_EMPTY (the default value). The example fails with this error even if the
output table does not exist before the example is run. 

In fact, the four pipelines corresponding to the four trigger types write to the same table.
The pipeline that finishes first will create the table and insert data into it. But the remaining
ones can only _append_ to that table. Hence, the problem can be avoided by setting WriteDisposition

This message was sent by Atlassian JIRA

View raw message