airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Buida (JIRA)" <j...@apache.org>
Subject [jira] [Work started] (AIRFLOW-1608) GCP Dataflow hook missing pending job state
Date Wed, 13 Sep 2017 15:29:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-1608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Work on AIRFLOW-1608 started by Thomas Buida.
---------------------------------------------
> GCP Dataflow hook missing pending job state
> -------------------------------------------
>
>                 Key: AIRFLOW-1608
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1608
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: contrib, Dataflow, gcp, hooks
>            Reporter: Thomas Buida
>            Assignee: Thomas Buida
>
> The Dataflow hook does not handle the pending job state and throws an exception when
it is encountered:
> {noformat}
> Exception: Google Cloud Dataflow job <job_name> was unknown state: JOB_STATE_PENDING
> {noformat}
> This causes Dataflow operator tasks to fail prematurely before even reaching one of the
running, failed, done, etc... states.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message