apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tushar Gosavi <tus...@datatorrent.com>
Subject Re: Shutdown of an Apex app
Date Wed, 18 Jan 2017 06:25:22 GMT
I think this would be a great addition for batch use cases or use
cases were DAG needs to be shutdown after detecting some
completion/error condition through the operator. We have one Jira
Opened for such functionality

- Tushar.

On Wed, Jan 18, 2017 at 11:45 AM, Bhupesh Chawda
<bhupesh@datatorrent.com> wrote:
> Hi All,
> Currently we can shutdown an Apex app in the following ways:
> 1. Throw ShutdownException() from *all* the input operators
> 2. Use Apex CLI to shutdown an app using the YARN App Id
> I think we should have some way of shutting down an application from within
> an operator. It is not always true that the trigger for shutdown is sent by
> the input operator only. Sometimes, an end condition may be detected by
> some operator in the DAG which wants the processing to end. Such a
> shutdown, although triggered from some intermediate operator in the DAG,
> should guarantee graceful shut down of the application.
> Thoughts?
> ~ Bhupesh

View raw message