falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pallavi Rao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-1231) Improve JobCompletionNotification Service
Date Wed, 09 Sep 2015 06:04:46 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14736239#comment-14736239
] 

Pallavi Rao commented on FALCON-1231:
-------------------------------------

Per today's discussion, there is an additional requirement to generate notification when instance
goes into "WAITING" state.  Based on that, I will update the patch to notify on "WAITING"
and "TIMED_OUT". 

For WAITING, I will introduce a new onWaiting() method to the listener interface.
However, "TIMED_OUT" will generate a FAILURE notification(onFailure()), with status set to
"TIMED_OUT". Basically, classifying any status other than SUCCESS/SUSPEND as failure.

[~ajayyadava], [~yzheng-hortonworks], does this address your use case?

> Improve JobCompletionNotification Service
> -----------------------------------------
>
>                 Key: FALCON-1231
>                 URL: https://issues.apache.org/jira/browse/FALCON-1231
>             Project: Falcon
>          Issue Type: Sub-task
>            Reporter: Pallavi Rao
>            Assignee: Pallavi Rao
>         Attachments: FALCON-1231-v1.patch, FALCON-1231-v1.patch, FALCON-1231.patch, FALCON-1231.patch,
OozieJobStatusNotification.pdf
>
>
> Workflow completion is currently dependent on post processing action putting messages
(success/failure) to a JMS queue.
> When failures occur on Hadoop / Oozie, the post processing action may not  get executed
either. In such cases, Falcon will be blind to the status of the workflow and re-tries will
not happen.
> Explore url notification of oozie to get job completion notifications. Fall back on polling
when workflows run beyond SLA.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message