airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (AIRFLOW-1386) Add a SLEEP state for sensors
Date Sun, 02 Sep 2018 17:58:02 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Apache Spark reassigned AIRFLOW-1386:
-------------------------------------

    Assignee:     (was: Holden Karau's magical unicorn)

> Add a SLEEP state for sensors
> -----------------------------
>
>                 Key: AIRFLOW-1386
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1386
>             Project: Apache Airflow
>          Issue Type: Wish
>          Components: scheduler
>            Reporter: Yong-Siang Shih
>            Priority: Minor
>
> Currently when the sensor is sleeping, the task process is in RUNING state and it still
consumes resources such as memory (because the process does not terminate). This is waste
of resource, especially when there are thousands of sensors sleeping and poking. Preferably
when it sleeps, it would enter a SLEEP state and terminate, waiting for scheduler to reschedule
it.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message