airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alex Guziel (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-1036) Exponential backoff should use randomization
Date Thu, 23 Mar 2017 19:07:41 GMT
Alex Guziel created AIRFLOW-1036:
------------------------------------

             Summary: Exponential backoff should use randomization
                 Key: AIRFLOW-1036
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1036
             Project: Apache Airflow
          Issue Type: Improvement
            Reporter: Alex Guziel
            Assignee: Alex Guziel


This prevents the thundering herd problem. I think with the current way this is used, we would
need to use some hashing function based on some subset of the dag_run, task_id, dag_id, and
execution_date to emulate the RNG.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message