airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-716) Allow schema-less BigQuery load job (for AVRO)
Date Thu, 29 Dec 2016 21:57:58 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15786222#comment-15786222
] 

ASF subversion and git services commented on AIRFLOW-716:
---------------------------------------------------------

Commit 410736dbc440d643fb3ea5f2094b64b8d4e3ba3b in incubator-airflow's branch refs/heads/master
from [~alexvanboxel]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=410736d ]

[AIRFLOW-716] Allow AVRO BigQuery load-job without schema

Now allow a load job without specifying the schema
fields or object.
This allows for loading files with embedded schema
like AVRO files.

Also made optional values None instead of False to
make it a bit more
Pythoneske without breaking compatibility.

Closes #1958 from
alexvanboxel/feature/bq_load_avro


> Allow schema-less BigQuery load job (for AVRO)
> ----------------------------------------------
>
>                 Key: AIRFLOW-716
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-716
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: gcp
>            Reporter: Alex Van Boxel
>            Assignee: Alex Van Boxel
>
> AVRO has it's format embedded and doesn't require that you specify the format with a
load job.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message