airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Buida (JIRA)" <>
Subject [jira] [Created] (AIRFLOW-1608) GCP Dataflow hook missing pending job state
Date Wed, 13 Sep 2017 15:29:00 GMT
Thomas Buida created AIRFLOW-1608:

             Summary: GCP Dataflow hook missing pending job state
                 Key: AIRFLOW-1608
             Project: Apache Airflow
          Issue Type: Bug
          Components: contrib, Dataflow, gcp, hooks
            Reporter: Thomas Buida
            Assignee: Thomas Buida

The Dataflow hook does not handle the pending job state and throws an exception when it is

Exception: Google Cloud Dataflow job <job_name> was unknown state: JOB_STATE_PENDING

This causes Dataflow operator tasks to fail prematurely before even reaching one of the running,
failed, done, etc... states.

This message was sent by Atlassian JIRA

View raw message