airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chao-Han Tsai <milton0...@gmail.com>
Subject Re: [DISCUSS] AIP-5: Remote DAG Fetcher
Date Thu, 02 May 2019 02:39:40 GMT
Dear Airflow committers,

What is the current process to get an AIP accepted/approved? I looked
through the
https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals
and
cwiki but couldn't find it documented anywhere.

Chao-Han

On Tue, Apr 30, 2019 at 9:23 PM Chao-Han Tsai <milton0825@gmail.com> wrote:

> Hi all,
>
> I would like to bump this thread up again to seek for more feedbacks from
> you for the AIP-5:
>
> https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-5+Remote+DAG+Fetcher
>
> In short, this AIP aims to enable Airflow to fetch DAG files from remote
> storage systems (git, s3,...) outside the file system local to the service.
> This grant a much greater flexibility, eases implementation, and
> standardizes ways to sync remote sources of DAGs with Airflow. It also
> opens up new opportunities for Airflow such as exposing all versions of
> DAGs to Airflow to support versioned DagRuns.
>
> Cheers,
>
> Chao-Han
>
>
>
> On Sat, Mar 23, 2019 at 9:56 PM Chao-Han Tsai <milton0825@gmail.com>
> wrote:
>
>> Hi Airflowers,
>>
>> We had an email thread
>> <https://lists.apache.org/thread.html/03ddcd3a42b7fd6e3dad9711e8adea37fc00391f6053762f73af5b6a@%3Cdev.airflow.apache.org%3E>
>>  and PR <https://github.com/apache/airflow/pull/3138> about supporting
>> remote DAG fetcher in the past and there was an AIP
>> <https://cwiki.apache.org/confluence/display/AIRFLOW/Deprecated-+AIP-5+DagFetcher>
about
>> it. But the author seems to be not working on it anymore, so I picked it up
>> and came up with a new AIP:
>>
>> https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-5+Remote+DAG+Fetcher
>>
>> I would like to hear your feedback and suggestions for improvement!
>>
>> Chao-Han Tsai
>>
>>
>
> --
>
> Chao-Han Tsai
>
>

-- 

Chao-Han Tsai

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message