airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ace Haidrey (JIRA)" <>
Subject [jira] [Created] (AIRFLOW-1735) Log files do not show up for unscheduled dags
Date Thu, 19 Oct 2017 03:21:00 GMT
Ace Haidrey created AIRFLOW-1735:

             Summary: Log files do not show up for unscheduled dags
                 Key: AIRFLOW-1735
             Project: Apache Airflow
          Issue Type: Bug
            Reporter: Ace Haidrey
            Assignee: Ace Haidrey
         Attachments: Screen Shot 2017-06-21 at 10.53.28 PM.png

I created a new dag with a schedule of {{@once}} and left it unscheduled.  I ran different
tasks a few times from the UI but the logs never showed up.  Instead I'd see messages like
the following:
*** Log file isn't local.
*** Fetching here:
*** Failed to fetch log file from worker.

There is a log file for this task, but it seems to be at a slightly different path on the

(airflow)hadoop@al-tools2:~/.virtualenvs/airflow$ ls -lth ./airflow_home/logs/analytics_kochava_import_dag/kopandoraradioandroid1134523b395684da7_request/2017-06-21T00\:00\:00
-rw-rw-rw- 1 hadoop hadoop 5.2K Jun 21 21:57 ./airflow_home/logs/analytics_kochava_import_dag/kopandoraradioandroid1134523b395684da7_request/2017-06-21T00:00:00

And indeed, when I change the URL to WEB_SERVER/admin/airflow/log?task_id=TASK_ID_request&dag_id=DAG_ID&execution_date=2017-06-21T00:00:00,
I see the actual log:

*** Reading local log.
[2017-06-21 21:57:20,931] {} INFO - Filling up the DagBag from ~/
[2017-06-21 21:57:21,307] {} INFO - Kochava app IDs 
[2017-06-21 21:57:26,400] {} INFO - Task exited with return code 0

I've added a screen shot of it below.

I have noticed in www/ the issue is not have the time component 00:00:00 and we can
get that quite easily if it doesnt have it. You can see in this PR I made.

This message was sent by Atlassian JIRA

View raw message