airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] jj-ian edited a comment on issue #4083: [AIRFLOW-3211] Reattach to GCP Dataproc jobs upon Airflow restart
Date Tue, 23 Oct 2018 14:47:28 GMT
jj-ian edited a comment on issue #4083: [AIRFLOW-3211] Reattach to GCP Dataproc jobs upon Airflow
restart 
URL: https://github.com/apache/incubator-airflow/pull/4083#issuecomment-432277828
 
 
   Hi @ashb, thank you for the review. I see what you mean, but we wanted to ensure that Airflow
keeps track of Dataproc jobs even if the machine that hosts Airflow restarts for reasons outside
our control. Our Airflow is hosted on machines that restart regularly for system updates (specifically,
[GCP App Engine Flex instances that are restarted weekly by Google to install OS updates](https://cloud.google.com/appengine/docs/flexible/python/how-instances-are-managed)).


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message