airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gabriele Angeletti (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-2188) Airflow DAG not running on scheduler
Date Wed, 07 Mar 2018 12:23:00 GMT
Gabriele Angeletti created AIRFLOW-2188:
-------------------------------------------

             Summary: Airflow DAG not running on scheduler
                 Key: AIRFLOW-2188
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2188
             Project: Apache Airflow
          Issue Type: Bug
          Components: scheduler
    Affects Versions: 1.9.0
         Environment: Ubuntu server 16.04 AMI on Amazon AWS.
            Reporter: Gabriele Angeletti
             Fix For: 1.9.0


I have an Airflow system (1.9.0) with the scheduler and the web service up and running. I
wrote a simple DAG that just prints hello world. The code for the DAG is the following:

{code:python}
import datetime

import airflow
from airflow import DAG
from airflow.operators.bash_operator import BashOperator

default_args = dict(
  owner="blackecho",
  start_date=datetime.datetime(2018, 3, 4),
  depends_on_past=False,
  retries=1,
  retry_delay=datetime.timedelta(minutes=5),
)

dag = DAG(
  dag_id="HelloWorld_2",
  default_args=default_args,
  schedule_interval=datetime.timedelta(minutes=10),
)

t1 = BashOperator(
  task_id="hello",
  bash_command="echo Hello world && sleep 1",
  dag=dag,
)

if __name__ == "__main__":
  dag.cli()
{code}

The problem is that the scheduler is not working:

* `airflow test HelloWorld_2 hello 2018-03-04` - this works with logs
* `airflow run HelloWorld_2 hello 2018-03-04` - this works with logs
* `airflow backfill HelloWorld_2 -s 2018-03-02 -e 2018-03-03` - this works with logs
* `airflow trigger_dag HelloWorld_2` - not working, and logs are not generated
* Click trigger dag from the Web UI - not working, and logs are not generated
* Scheduled jobs - not working, and logs are not generated

Here is some of my configs:

airflow_home = /home/ubuntu/airflow
 dags_folder = /home/ubuntu/airflow/dags
 base_log_folder = /home/ubuntu/airflow/logs
 remote_logging = False
 remote_log_conn_id =
 encrypt_s3_logs = False
 logging_config_class =
 executor = LocalExecutor
 task_runner = BashTaskRunner
 task_log_reader = file.task

Also, the scheduler is printing `No tasks to consider for execution.`, don't know if that's
related.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message