airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ash Berlin-Taylor (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-2865) Race condition between on_success_callback and LocalTaskJob's cleanup
Date Tue, 06 Nov 2018 14:02:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ash Berlin-Taylor updated AIRFLOW-2865:
---------------------------------------
    Fix Version/s: 1.10.1

> Race condition between on_success_callback and LocalTaskJob's cleanup
> ---------------------------------------------------------------------
>
>                 Key: AIRFLOW-2865
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2865
>             Project: Apache Airflow
>          Issue Type: Bug
>            Reporter: Marcin Mejran
>            Priority: Minor
>             Fix For: 2.0.0, 1.10.1
>
>
> The TaskInstance's run_raw_task method first records SUCCESS for the task instance and
then runs the on_success_callback function.
> The LocalTaskJob's heartbeat_callback checks for any TI's with a SUCCESS state and
terminates their processes.
> As such it's possible for the TI process to be terminated before the on_success_callback
function finishes running.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message