falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pallavi Rao (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FALCON-1677) Support re-tries for timed-out instances
Date Mon, 21 Dec 2015 05:38:46 GMT
Pallavi Rao created FALCON-1677:

             Summary: Support re-tries for timed-out instances
                 Key: FALCON-1677
                 URL: https://issues.apache.org/jira/browse/FALCON-1677
             Project: Falcon
          Issue Type: Bug
            Reporter: Pallavi Rao

Currently, Falcon retries only on failure. We should extend support in case of timed-out instances
too. Earlier, since we were relying on post-processing to notify the instance status, this
was not possible. Now that Falcon relies on Oozie JMS notifications, we can support retries
for timed out instances too.

If a dataset is expected to get delayed for a long time, the user is currently forced to supply
a large timeout value. This is an overhead in terms of Oozie having to poll for that long.
If we introduce retries, the timeout can be a reasonable value with periodic/exponential back-off

This message was sent by Atlassian JIRA

View raw message