airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dan Davydov (JIRA)" <>
Subject [jira] [Created] (AIRFLOW-385) Scheduler logs should have a "latest" directory
Date Fri, 29 Jul 2016 18:39:20 GMT
Dan Davydov created AIRFLOW-385:

             Summary: Scheduler logs should have a "latest" directory
                 Key: AIRFLOW-385
             Project: Apache Airflow
          Issue Type: Improvement
          Components: logging
            Reporter: Dan Davydov

Right now the scheduler logs for each parsed file look like /tmp/airflow/scheduler/logs/2016-07-17/some-dag/...
The problem is this makes it hard to find the latest logs which is the most frequent use case.

Ideally we would create and have the scheduler keep up to date a symlink to the latest date
/tmp/airflow/scheduler/logs/latest which would point to e.g. /tmp/airflow/scheduler/logs/2016-07-17

We might also want to consider changing the structure to dag/date instead of date/dag too,
but that can be done as a separate task if desired.

This message was sent by Atlassian JIRA

View raw message