airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Adinata <mail.die...@gmail.com>
Subject Specifying memory limit for task
Date Fri, 05 Aug 2016 03:23:40 GMT
Is there any way for task instances to limit the memory task execution?

I run the worker inside docker container, hence when it uses high memory,
the container was killed.
Airflow then detect it as zombie (well the email notification failure told
me that). It would be great if
I know it was killed because of oom, so I know what to fix after instead of
wondering first why it was
becoming a zombie.

Thanks
--
*Adinata*
Engineer - UrbanIndo.com

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message