beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jean-Christophe Rodrigue (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BEAM-2332) beam.io.BigQuerySink Python SDK does not support WRITE_TRUNCATE write disposition when specifying table with partition decorator
Date Fri, 19 May 2017 18:45:04 GMT
Jean-Christophe Rodrigue created BEAM-2332:
----------------------------------------------

             Summary: beam.io.BigQuerySink Python SDK does not support WRITE_TRUNCATE write
disposition when specifying table with partition decorator
                 Key: BEAM-2332
                 URL: https://issues.apache.org/jira/browse/BEAM-2332
             Project: Beam
          Issue Type: Bug
          Components: sdk-py
    Affects Versions: 2.0.0
         Environment: OSX 
            Reporter: Jean-Christophe Rodrigue
            Assignee: Ahmet Altay


When trying to write to a BigQuery partition with this transform 

pcoll | beam.io.Write(beam.io.BigQuerySink(table, schema=self.get_schema(), 
         create_disposition=beam.io.BigQueryDisposition.CREATE_NEVER,
         write_disposition=beam.io.BigQueryDisposition.WRITE_TRUNCATE)))

I get the following error code: 

"code": 400,
  "message": "Invalid table ID \"table$20170103\". Table IDs must be alphanumeric (plus underscores)
and must be at most 1024 characters long. Also, Table decorators cannot be used."

The table is partitioned by day already.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message