airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ashwin Sai Shankar <ashan...@slack-corp.com.INVALID>
Subject Dag storage in airflow on kube
Date Wed, 08 May 2019 20:32:57 GMT
Hi!
In airflow on kube deployment, which of the following options would you
recommend to store dags in a production env and why? This is for about 1000
dags and everyday ~20 commits are made to dags folder
a)EFS/NFS volume
b) git sync (every container is going to do a git pull before running task)
c) bake dags into image
d)s3-sync

Thanks,
Ash

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message