airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bence Nagy (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-93) Allow specifying multiple task execution deltas for ExternalTaskSensors
Date Tue, 10 May 2016 11:59:12 GMT
Bence Nagy created AIRFLOW-93:
---------------------------------

             Summary: Allow specifying multiple task execution deltas for ExternalTaskSensors
                 Key: AIRFLOW-93
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-93
             Project: Apache Airflow
          Issue Type: Improvement
          Components: operators
    Affects Versions: Airflow 1.7.0
            Reporter: Bence Nagy
            Priority: Minor


I have some {{ExternalTaskSensor}}s with a schedule interval of 1 hour, where the task depended
upon has a schedule interval of 10 minutes. Right now I'm depending only on the HH:50 execution,
but it would be nice if I could specify a range that I need all executions from HH:00 to HH:50
successful; otherwise if the depended upon tasks are executed out of order the sensor will
pass even though I don't have data for the earlier parts of the hour yet.

A workaround would be to have one sensor for each 10 minutes of the hour, but that's too nasty
for me. Especially if my sensor's schedule interval would be 1 day.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message