airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ash Berlin-Taylor <...@apache.org>
Subject Re: Recommended backend metastore for Airflow
Date Mon, 10 Dec 2018 15:12:41 GMT
Postgres.

Friends don't let friends use MySQL is my personal rule.

(I can get in to the reasons if you'd like, but the short version is I find Postgres has more
compliant behaviour with SQL standard, and a much better query planner.)

-ash

> On 10 Dec 2018, at 15:10, ramandumcs@gmail.com wrote:
> 
> Hi All,
> 
> It seems that Airflow supports mysql, postgresql and mssql as backend store. Any recommendation
on using one over other. We are expecting to run 1000(s) of concurrent Dags which would generate
heavy load on backend store.
> Any pointer on this would be useful.
> 
> Thanks,
> Raman Gupta


Mime
View raw message