airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marcin Mejran (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-2865) Race condition between on_success_callback and LocalTaskJob's cleanup
Date Tue, 07 Aug 2018 18:48:00 GMT
Marcin Mejran created AIRFLOW-2865:
--------------------------------------

             Summary: Race condition between on_success_callback and LocalTaskJob's cleanup
                 Key: AIRFLOW-2865
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2865
             Project: Apache Airflow
          Issue Type: Bug
            Reporter: Marcin Mejran


The TaskInstance's run_raw_task method first records SUCCESS for the task instance and then
runs the on_success_callback function.

The LocalTaskJob's heartbeat_callback checks for any TI's with a SUCCESS state and terminates
their processes.

As such it's possible for the TI process to be terminated before the on_success_callback
function finishes running.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message