beam-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brian Hulette (Jira)" <j...@apache.org>
Subject [jira] [Updated] (BEAM-8560) Construction time schema Validation for writing to BQ
Date Tue, 02 Jun 2020 17:00:12 GMT

     [ https://issues.apache.org/jira/browse/BEAM-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Brian Hulette updated BEAM-8560:
--------------------------------
    Labels:   (was: stale-assigned)

> Construction time schema Validation for writing to BQ
> -----------------------------------------------------
>
>                 Key: BEAM-8560
>                 URL: https://issues.apache.org/jira/browse/BEAM-8560
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-core
>            Reporter: Brian Hulette
>            Assignee: Brian Hulette
>            Priority: P2
>
> `BigQueryIO.write` should be able to validate the schema of the input PCollection against
the schema for this table (either retrieved from DataCatalog, or from BQ metadata). Then we
can fail at pipeline construction time rather than waiting until execution.
> At the very least this should work when writing Beam Rows.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message