airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arjun Arippa (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (AIRFLOW-1400) catchup=False caused exception
Date Mon, 13 Nov 2017 10:09:00 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-1400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16249331#comment-16249331
] 

Arjun Arippa edited comment on AIRFLOW-1400 at 11/13/17 10:08 AM:
------------------------------------------------------------------

I'm also getting the same error when trying with the pattern:


{code:
default_args = {
    'owner': 'airflow',
    'depends_on_past': False,
    'start_date': datetime(2017,11,13),
    'email': ['airflow@airflow.com'],
    'email_on_failure': False,
    'email_on_retry': False,
    'retries': 1,
    'retry_delay': timedelta(seconds=5)
}

dag = DAG(
        dag_id='my_dag_id', default_args=default_args, 
{code}
schedule_interval='@once',concurrency=1)
}
I'm using airflow version 1.8.0.

Thnx,
Arjun


was (Author: arjun.arippa):
I'm also getting the same error when trying with the pattern:

default_args = {
    'owner': 'airflow',
    'depends_on_past': False,
    'start_date': datetime(2017,11,13),
    'email': ['airflow@airflow.com'],
    'email_on_failure': False,
    'email_on_retry': False,
    'retries': 1,
    'retry_delay': timedelta(seconds=5)
}

dag = DAG(
        dag_id='my_dag_id', default_args=default_args, schedule_interval='@once',concurrency=1)

I'm using airflow version 1.8.0.

Thnx,
Arjun

> catchup=False caused exception
> ------------------------------
>
>                 Key: AIRFLOW-1400
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1400
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: scheduler
>    Affects Versions: Airflow 1.8
>            Reporter: Xi Wang
>
> When I set of the task with catchup=False, it threw a error as follow(logs/scheduler/my_dag_name):
> [2017-07-10 15:13:12,534] {jobs.py:354} DagFileProcessor373 ERROR - Got an exception!
Propagating...
> Traceback (most recent call last):
>   File "/usr/lib/python2.7/site-packages/airflow/jobs.py", line 346, in helper
>     pickle_dags)
>   File "/usr/lib/python2.7/site-packages/airflow/utils/db.py", line 53, in wrapper
>     result = func(*args, **kwargs)
>   File "/usr/lib/python2.7/site-packages/airflow/jobs.py", line 1581, in process_file
>     self._process_dags(dagbag, dags, ti_keys_to_schedule)
>   File "/usr/lib/python2.7/site-packages/airflow/jobs.py", line 1171, in _process_dags
>     dag_run = self.create_dag_run(dag)
>   File "/usr/lib/python2.7/site-packages/airflow/utils/db.py", line 53, in wrapper
>     result = func(*args, **kwargs)
>   File "/usr/lib/python2.7/site-packages/airflow/jobs.py", line 776, in create_dag_run
>     if next_start <= now:
> TypeError: can't compare datetime.datetime to NoneType
> It seems next_start was not defined properly, (https://github.com/apache/incubator-airflow/blob/master/airflow/jobs.py#L777)
> Any help is appreciated.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message