airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jack (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-3399) BashOperator - bash_command is not rechecked after retry
Date Mon, 26 Nov 2018 14:51:00 GMT
jack created AIRFLOW-3399:
-----------------------------

             Summary: BashOperator - bash_command is not rechecked after retry
                 Key: AIRFLOW-3399
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3399
             Project: Apache Airflow
          Issue Type: Bug
    Affects Versions: 1.9.0
            Reporter: jack


The operator does not check if bash_command parameter was changed between retries.

 

Steps to reproduce:

Create operator:
{code:java}
test = BashOperator(task_id='my_id',
     bash_command="python3.6 testing.py '{{ params.start_date }}' ",
     dag=dag){code}
 

 

Say that testing.py fails (wrong py file given) -  task is set on up_for_retry

change it to the right one:

 
{code:java}
test = BashOperator(task_id='my_id',
     bash_command="python3.6 testing_a.py '{{ params.start_date }}' ",
     dag=dag){code}
 

clear the task.

Airflow will execute testing.py again and not testing_a.py

 

Only if clearing the up stream task of the BashOperator then it recheck the bash command python
file.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message