airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-2861) Need index on log table
Date Wed, 08 Aug 2018 17:14:00 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-2861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16573531#comment-16573531
] 

ASF subversion and git services commented on AIRFLOW-2861:
----------------------------------------------------------

Commit 6f7fe74b9ff6c2abae2764988c152af8bcc8e199 in incubator-airflow's branch refs/heads/master
from [~vardan]
[ https://gitbox.apache.org/repos/asf?p=incubator-airflow.git;h=6f7fe74 ]

[AIRFLOW-2861] Add index on log table (#3709)



> Need index on log table
> -----------------------
>
>                 Key: AIRFLOW-2861
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2861
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: database
>    Affects Versions: 1.10.0
>            Reporter: Vardan Gupta
>            Assignee: Vardan Gupta
>            Priority: Major
>
> Delete dag functionality is added in v1-10-stable, whose implementation during the metadata
cleanup [part|https://github.com/apache/incubator-airflow/blob/dc78b9196723ca6724185231ccd6f5bbe8edcaf3/airflow/api/common/experimental/delete_dag.py#L48],
look for classes which has attribute named as dag_id and then formulate the query on matching
model and then delete from metadata, we've few numbers where we've observed slowness especially
in log table because it doesn't have any single or multiple-column index. Creating an index
would boost the performance though insertion will be a bit slower. Since deletion will be
a sync call, would be good idea to create index.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message