airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ben Tallman <btall...@gmail.com>
Subject Re: Custom scheduler support in Airflow
Date Thu, 31 Jan 2019 16:53:32 GMT
Can you explain a bit more what you are thinking for a custom scheduler?
It's been awhile, but we added support for cron schedules without backfill
awhile back, so I'm wondering what you are thinking of adding with this?

Thanks,
Ben

--
Ben Tallman - 503.680.5709


On Thu, Jan 31, 2019 at 8:29 AM abhishek sharma <abhioncbr.apache@gmail.com>
wrote:

> Hi All,
>
> Created a ticket(https://issues.apache.org/jira/browse/AIRFLOW-3775) for
> supporting custom scheduler in Airflow.
>
> The idea is to have a scheduler base class which can be extended for
> writing a custom scheduler. The logic of custom scheduling is user
> specific, and at the DAGs task level we can mention the scheduler type, and
> that scheduler will be used for starting a task. [Naive Idea]
>
> Can we please discuss whether we need such functionality in Airflow or not
> and If yes then we will proceed with the design and implementation.
>
> Thanks
> Abhishek Sharma
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message