airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bolke de Bruin (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-52) Release airflow 1.7.1
Date Fri, 06 May 2016 12:09:12 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-52?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Bolke de Bruin updated AIRFLOW-52:
----------------------------------
    Description: 
Release the airflow 1.7.1 tag.

Current status:
There are three issues blocking this release caused by this commit:
https://github.com/apache/incubator-airflow/commit/fb0c5775cda4f84c07d8d5c0e6277fc387c172e6
1. DAGs with a lot of tasks take much longer to parse (~25x slowdown)
2. The following kind of patterns fail:
{code}
email.set_upstream(dag.roots)
dag.add_task(email)
{code}
This is because set_upstream now calls add_task and a task can't be added more than once.

I'm working with the owner of the commit to resolve these issues.

The way to catch (1) in the future is an integration test that asserts a given non-trivial
DAG parses under X seconds.
3. Airflow loosing queued tasks (see linked issue)

  was:
Release the airflow 1.7.1 tag.

Current status:
There are two issues blocking this release caused by this commit:
https://github.com/apache/incubator-airflow/commit/fb0c5775cda4f84c07d8d5c0e6277fc387c172e6
1. DAGs with a lot of tasks take much longer to parse (~25x slowdown)
2. The following kind of patterns fail:
{code}
email.set_upstream(dag.roots)
dag.add_task(email)
{code}
This is because set_upstream now calls add_task and a task can't be added more than once.

I'm working with the owner of the commit to resolve these issues.

The way to catch (1) in the future is an integration test that asserts a given non-trivial
DAG parses under X seconds.


> Release airflow 1.7.1
> ---------------------
>
>                 Key: AIRFLOW-52
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-52
>             Project: Apache Airflow
>          Issue Type: Task
>          Components: ease
>            Reporter: Dan Davydov
>            Assignee: Dan Davydov
>              Labels: release
>
> Release the airflow 1.7.1 tag.
> Current status:
> There are three issues blocking this release caused by this commit:
> https://github.com/apache/incubator-airflow/commit/fb0c5775cda4f84c07d8d5c0e6277fc387c172e6
> 1. DAGs with a lot of tasks take much longer to parse (~25x slowdown)
> 2. The following kind of patterns fail:
> {code}
> email.set_upstream(dag.roots)
> dag.add_task(email)
> {code}
> This is because set_upstream now calls add_task and a task can't be added more than once.
> I'm working with the owner of the commit to resolve these issues.
> The way to catch (1) in the future is an integration test that asserts a given non-trivial
DAG parses under X seconds.
> 3. Airflow loosing queued tasks (see linked issue)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message