airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Deo (JIRA)" <>
Subject [jira] [Created] (AIRFLOW-1161) HttpHook shall be configurable to non-status errors
Date Sat, 29 Apr 2017 05:21:04 GMT
Deo created AIRFLOW-1161:

             Summary: HttpHook shall be configurable to non-status errors
                 Key: AIRFLOW-1161
             Project: Apache Airflow
          Issue Type: Improvement
            Reporter: Deo

When using HttpSensor, which underlying would use HttpHook to perform the request. If the
target service is down, which refused the connection, the task would fail immediately.

would be great if this behaviour is configurable, so the sensor would keep sensoring until
the service is up again.

traceback of the error:
[2017-04-29 02:00:31,248] {} INFO - Subtask: requests.exceptions.ConnectionError:
HTTPConnectionPool(host='xxxx', port=123): Max retries exceeded with url: /xxxx (Caused by
NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f94b64b44e0>:
Failed to establish a new connection: [Errno 111] Connection refused',))

This message was sent by Atlassian JIRA

View raw message