airflow-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lewis John McGibbney <lewi...@apache.org>
Subject Re: Backing up PostgreSQL DB on K8s
Date Wed, 09 Jun 2021 23:10:31 GMT
Hi Sumit,
Thanks for the suggestion.
We will experiment with extending the Helm chart to bake in in the PVC and PV objects... I
can't see anything like this so far digging through the code so I feel it is lacking. Being
able to configure this in values.yaml or CLI during install and update would be great.
Thank you

On 2021/06/09 05:41:13, Sumit Maheshwari <msumit@apache.org> wrote: 
> If you are backing up data to safeguard against pod failures, then I
> believe that you can use a PV as data storage for PSql & it would survive
> any pod restarts.
> 
> On Wed, Jun 9, 2021 at 5:01 AM Lewis John McGibbney <lewismc@apache.org>
> wrote:
> 
> > Hi users@,
> > Does anyone have a recommended/best practice/preferred way for backing up
> > PostgreSQL when Airflow is deployed into K8s?
> > We were thinking of writing a maintenance DAG which would do this... maybe
> > even contributing it to
> > https://github.com/teamclairvoyant/airflow-maintenance-dags.
> > I'm thinking it would just authenticate into the K8s cluster, find the
> > postgresql pod and then perform a DB archival in s3 or something.
> > I also looked more into
> > https://www.postgresql.org/docs/9.1/continuous-archiving.html which looks
> > appealing. I'm interest to see what others are doing.
> > Any suggestions appreciated.
> > Thank you
> > lewismc
> >
> 

Mime
View raw message