airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-921) 1.8.0rc Issues
Date Mon, 13 Mar 2017 02:50:05 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906802#comment-15906802
] 

ASF subversion and git services commented on AIRFLOW-921:
---------------------------------------------------------

Commit a8f2c27ed44449e6611c7c4a9ec8cf2371cf0987 in incubator-airflow's branch refs/heads/v1-8-test
from [~bolke]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=a8f2c27 ]

AIRFLOW-932][AIRFLOW-932][AIRFLOW-921][AIRFLOW-910] Do not mark tasks removed when backfilling[

In a backfill one can specify a specific task to
execute. We
create a subset of the orginal tasks in a subdag
from the original dag.
The subdag has the same name as the original dag.
This breaks
the integrity check of a dag_run as tasks are
suddenly not in
scope any more.

Closes #2122 from bolkedebruin/AIRFLOW-921


> 1.8.0rc Issues
> --------------
>
>                 Key: AIRFLOW-921
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-921
>             Project: Apache Airflow
>          Issue Type: Task
>            Reporter: Dan Davydov
>            Assignee: Bolke de Bruin
>            Priority: Blocker
>             Fix For: 1.8.0
>
>
> These are the pending issues for the Airflow 1.8.0 release:
> Blockers:
> [~bolke] please merge into the next RC and then remove from the list the sub-tasks linked
in this JIRA
> Other Issues:
> - High DB Load (~8x more than 1.7) - We are still investigating but it's probably not
a blocker for the release - (Theories: Might need execution_date index on dag_run (based on
slow process list) OR it might be this query which is long running SELECT union_ti.dag_id
AS union_ti_dag_id, union_ti.state AS union_ti_state, count( *) AS count_1
> FR))
> - Front page loading time is a lot slower
> [~bolke]



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message