airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] phani8996 commented on issue #3989: [AIRFLOW-1945] Autoscale celery workers for airflow added
Date Mon, 08 Oct 2018 17:55:54 GMT
phani8996 commented on issue #3989: [AIRFLOW-1945] Autoscale celery workers for airflow added
URL: https://github.com/apache/incubator-airflow/pull/3989#issuecomment-427924698
 
 
   > @phani8996 whats harm in letting my machine run with the full capacity of workers
all the time? Cause if I am allowing to grow it to a max, then it means that my machine has
the capacity to handle that many workers anyway.
   
   We can run it at full capacity, but what advantage are we going to get with a bunch of
idle workers? Instead this feature spawns workers as per demand. In a way you get what is
required. No more under utilisation of workers.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message