airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Christian D (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-2158) Airflow should not store logs as raw ISO timestamps
Date Wed, 28 Feb 2018 18:18:00 GMT
Christian D created AIRFLOW-2158:
------------------------------------

             Summary: Airflow should not store logs as raw ISO timestamps
                 Key: AIRFLOW-2158
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2158
             Project: Apache Airflow
          Issue Type: Improvement
         Environment: 1.9.0
            Reporter: Christian D
             Fix For: Airflow 2.0


Problem:
When Airflow writes logs to disk, it uses a ISO-8601 timestamp as the filename. In a Linux
filesystem this works completely fine (because all characters in a ISO-8601 timestamp is allowed).
However, it doesn't work on Windows based systems  (including Azure File Storage) because
{{:}} is a disallowed character.

Solution:
Ideally, Airflow should store logs such that they're somewhat compatible across file systems.
An easy way of fixing this would therefore be to always replace {{:}} with underscores.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message