airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kaxil Naik (Jira)" <j...@apache.org>
Subject [jira] [Work started] (AIRFLOW-5943) DAG Serialization & DB Persistence
Date Sat, 16 Nov 2019 00:58:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-5943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Work on AIRFLOW-5943 started by Kaxil Naik.
-------------------------------------------
> DAG Serialization & DB Persistence
> ----------------------------------
>
>                 Key: AIRFLOW-5943
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5943
>             Project: Apache Airflow
>          Issue Type: Epic
>          Components: core
>    Affects Versions: 1.10.5, 1.10.6
>            Reporter: Kaxil Naik
>            Assignee: Kaxil Naik
>            Priority: Major
>             Fix For: 2.0.0, 1.10.7
>
>
> This Epic aims to decouple Webserver from having to parse the DAG files. Short-term Scheduler
will parse the DAG files and persist it in DB. Longer term we would have a new airflow component
"Serializer"/"Parser" that would be the component parsing DAG files, serializing DAG objects
and persisting it to DB. This would be the Webserver & Scheduler would not need access
to DAG files.
> More details Implementing AIP-24: https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-24+DAG+Persistence+in+DB+using+JSON+for+Airflow+Webserver+and+%28optional%29+Scheduler



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message