airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dan Davydov (JIRA)" <>
Subject [jira] [Created] (AIRFLOW-1620) Support granular and customizable hook retries
Date Mon, 18 Sep 2017 23:19:00 GMT
Dan Davydov created AIRFLOW-1620:

             Summary: Support granular and customizable hook retries
                 Key: AIRFLOW-1620
             Project: Apache Airflow
          Issue Type: Bug
            Reporter: Dan Davydov

We need some kind of abstraction to allow for granular and customized retry handling for hooks.
For example, some users might want to catch certain types of exceptions, and with a customized
retry policy (e.g. exponential backoff), depending on their use cases.

One possible solution is to use dependency injection (e.g. hooks need to be passed into operators).

This message was sent by Atlassian JIRA

View raw message