beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ward Van Assche (JIRA)" <>
Subject [jira] [Created] (BEAM-3313) Support BigQuery DML in BigQueryIO.Write
Date Thu, 07 Dec 2017 09:29:00 GMT
Ward Van Assche created BEAM-3313:

             Summary: Support BigQuery DML in BigQueryIO.Write
                 Key: BEAM-3313
             Project: Beam
          Issue Type: New Feature
          Components: sdk-java-gcp
            Reporter: Ward Van Assche
            Assignee: Chamikara Jayalath

Since 2016 it's possible to use DML functionality in BigQuery when using standard SQL. It
would be great to also support this in Beam. Analogous to BigQueryIO.Read::fromQuery maybe
a BigQueryIO.Write::withQuery method can be added, which is supported when standard SQL is

The reason why I think this is a major issue: within a few months GDPR goes into effect in
the EU. This law enforces companies to support deleting all data from a certain customer.
I think this feature would be useful in order to automate the deletion/fuzzing process of
personal customer data.

This message was sent by Atlassian JIRA

View raw message