airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <>
Subject [jira] [Commented] (AIRFLOW-780) The UI no longer shows broken DAGs
Date Fri, 27 Jan 2017 09:39:24 GMT


ASF subversion and git services commented on AIRFLOW-780:

Commit b71037dd402f60f5ea4061354c90e39e4d2d8827 in incubator-airflow's branch refs/heads/apache/v1-8-test
from [~aoen]
[;h=b71037d ]

[AIRFLOW-780] Fix dag import errors no longer working

The import errors were no longer working after the
multiprocessor update
(since they are cleared after each DAG directory
is parsed). This change
fixes them, and adds tests to prevent future

Also fix a couple of linter errors.

Note that there are a few inefficiencies (e.g.
sometimes we delete then add import errors in the
same place instead of just doing an update), but
this is equivalent to the old behavior.

Testing Done:
- Added missing unit tests for dag imports. Note
that some of them strangely fail for python 3 and
it became too time consuming to debug since I
don't have a copy of the travis environment, I
even ran with the same version of python locally
and couldn't reproduce. I have skipped those 3
tests in python 3 for now.

Closes #2018 from aoen/fix_parse_errors_not_displa

> The UI no longer shows broken DAGs
> ----------------------------------
>                 Key: AIRFLOW-780
>                 URL:
>             Project: Apache Airflow
>          Issue Type: Bug
>            Reporter: Dan Davydov
>            Assignee: Dan Davydov
>            Priority: Critical
>             Fix For: 1.8.1
> When a faulty dag is placed in the dags folder the UI would report a parsing error. Now
it doesn’t due to the separate parising (but not reporting back errors)

This message was sent by Atlassian JIRA

View raw message