airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tim (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-456) DAG status still running when all its tasks are complete
Date Mon, 22 Aug 2016 16:24:21 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Tim updated AIRFLOW-456:
------------------------
    Description: 
Airflow doesn't flag the DAG's as success even though all of the tasks in that DAG are complete.
Once it gets to 16 "running" it doesn't run anymore.

https://puu.sh/qKoWI/6837ea5551.png

My DAG
{code:title=tutorial.py|borderStyle=solid}
from airflow import DAG
from airflow.operators.bash_operator import BashOperator
from datetime import datetime, timedelta


default_args = {
    'owner': 'airflow',
    'depends_on_past': False,
    'start_date': datetime(2016, 8, 22),
    'email': ['airflow@airflow.com'],
    'email_on_failure': False,
    'email_on_retry': False,
    'retries': 1,
    'retry_delay': timedelta(minutes=5),
    # 'queue': 'bash_queue',
    # 'pool': 'backfill',
    # 'priority_weight': 10,
    # 'end_date': datetime(2016, 1, 1),
}

dag = DAG(
    'tutorial', default_args=default_args, schedule_interval='0,15,30,45 * * * *', dagrun_timeout=timedelta(minutes=1))

# t1, t2 and t3 are examples of tasks created by instantiating operators
t1 = BashOperator(
    task_id='print_date',
    bash_command='date',
    dag=dag)
{code}


  was:
Airflow doesn't flag the DAG's as success even though all of the tasks in that DAG are complete.
Once it gets to 16 "running" it doesn't run anymore.

https://puu.sh/qKoWI/6837ea5551.png



> DAG status still running when all its tasks are complete
> --------------------------------------------------------
>
>                 Key: AIRFLOW-456
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-456
>             Project: Apache Airflow
>          Issue Type: Bug
>    Affects Versions: Airflow 1.7.1.3
>            Reporter: Tim
>
> Airflow doesn't flag the DAG's as success even though all of the tasks in that DAG are
complete. Once it gets to 16 "running" it doesn't run anymore.
> https://puu.sh/qKoWI/6837ea5551.png
> My DAG
> {code:title=tutorial.py|borderStyle=solid}
> from airflow import DAG
> from airflow.operators.bash_operator import BashOperator
> from datetime import datetime, timedelta
> default_args = {
>     'owner': 'airflow',
>     'depends_on_past': False,
>     'start_date': datetime(2016, 8, 22),
>     'email': ['airflow@airflow.com'],
>     'email_on_failure': False,
>     'email_on_retry': False,
>     'retries': 1,
>     'retry_delay': timedelta(minutes=5),
>     # 'queue': 'bash_queue',
>     # 'pool': 'backfill',
>     # 'priority_weight': 10,
>     # 'end_date': datetime(2016, 1, 1),
> }
> dag = DAG(
>     'tutorial', default_args=default_args, schedule_interval='0,15,30,45 * * * *', dagrun_timeout=timedelta(minutes=1))
> # t1, t2 and t3 are examples of tasks created by instantiating operators
> t1 = BashOperator(
>     task_id='print_date',
>     bash_command='date',
>     dag=dag)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message