airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeremiah Lowin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-22) Google cloud code needs tests
Date Tue, 10 May 2016 03:12:12 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277534#comment-15277534
] 

Jeremiah Lowin commented on AIRFLOW-22:
---------------------------------------

Can public buckets/BQ datasets (thinking about GDELT) be used without a project?

> Google cloud code needs tests
> -----------------------------
>
>                 Key: AIRFLOW-22
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-22
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: gcp
>            Reporter: Chris Riccomini
>              Labels: gcp
>
> The Google cloud contrib hooks and operators need tests to verify that they work. This
is somewhat tricky since they're hard to mock, and most of the value comes from integration
tests, not unit tests.
> I spoke with [~alexvanboxel], and he suggested just writing a script that can be run
manually, and exercises the hooks/operators to verify that they work as expected. I think
this is about the best we can do without spending a ton of time on it, since most of the integration
tests require a real Google cloud project, with real buckets/BQ datasets/DBs, etc. Running
it locally means we can run the tests against whatever projects we have access to.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message