airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yong-Siang Shih (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-1386) Add a SLEEP state for sensors
Date Fri, 07 Jul 2017 14:26:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Yong-Siang Shih updated AIRFLOW-1386:
-------------------------------------
    External issue URL: https://github.com/apache/incubator-airflow/pull/2423
           Description: Currently when the sensor is sleeping, the task process is in RUNING
state and it still consumes resources such as memory (because the process does not terminate).
This is waste of resource, especially when there are thousands of sensors sleeping and poking.
Preferably when it sleeps, it would enter a SLEEP state and terminate, waiting for scheduler
to reschedule it.  (was: Currently when the sensor is sleeping, the task process is in RUNNING
state and it still consumes resources such as memory (because the process does not terminate).
This is waste of resource, especially when there are thousands of sensors sleeping and poking.
Preferably when it sleeps, it would enter a SLEEP state and terminate, waiting for scheduler
to reschedule it.)

> Add a SLEEP state for sensors
> -----------------------------
>
>                 Key: AIRFLOW-1386
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1386
>             Project: Apache Airflow
>          Issue Type: Wish
>          Components: scheduler
>            Reporter: Yong-Siang Shih
>
> Currently when the sensor is sleeping, the task process is in RUNING state and it still
consumes resources such as memory (because the process does not terminate). This is waste
of resource, especially when there are thousands of sensors sleeping and poking. Preferably
when it sleeps, it would enter a SLEEP state and terminate, waiting for scheduler to reschedule
it.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message