airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harvey Xia (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-747) retry_delay not honored
Date Wed, 11 Jan 2017 17:31:48 GMT
Harvey Xia created AIRFLOW-747:
----------------------------------

             Summary: retry_delay not honored
                 Key: AIRFLOW-747
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-747
             Project: Apache Airflow
          Issue Type: Bug
            Reporter: Harvey Xia


In Airflow 1.8 alpha 2, using LocalExecutor, DAGs do not seem to honor the retry_delay parameter,
i.e. the retries happen immediately one after the other without waiting the specific retry_delay
time. However, the number of retries is honored. I am testing with the following code:

from airflow import DAG
from airflow.operators.bash_operator import BashOperator
from datetime import datetime, timedelta

default_args = {
'owner': 'airflow',
'depends_on_past': False,
'start_date': datetime(2016, 10, 5, 19),
'end_date': datetime(2016, 10, 6, 19),
'email': ['airflow@airflow.com'],
'email_on_failure': False,
'email_on_retry': False,
'retries': 10,
'retry_delay': timedelta(0, 500)
}

dag = DAG('test_retry_handling_job', default_args=default_args, schedule_interval='@once')

task1 = BashOperator(
task_id='test_retry_handling_op1',
bash_command='exit 1',
dag=dag)

task2 = BashOperator(
task_id='test_retry_handling_op2',
bash_command='exit 1',
dag=dag)

task2.set_upstream(task1)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message