flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Till Rohrmann <trohrm...@apache.org>
Subject Re: Connecting workflows in batch
Date Thu, 02 Mar 2017 14:21:20 GMT
Hi Mohit,

StreamExecutionEnvironment.execute() will only return giving you the
JobExecutionResult after the job has reached a final stage. If that works
for you to schedule the second job, then it should be ok to combine both
jobs in one program and execute the second job after the first one has


On Thu, Mar 2, 2017 at 2:33 AM, Mohit Anchlia <mohitanchlia@gmail.com>

> It looks like JobExecutionResult can be used here by using the
> accumulators?
> On Wed, Mar 1, 2017 at 8:37 AM, Aljoscha Krettek <aljoscha@apache.org>
> wrote:
>> I think right now the best option is the JobManager REST interface:
>> https://ci.apache.org/projects/flink/flink-docs-r
>> elease-1.3/monitoring/rest_api.html
>> You would have to know the ID of your job and then you can poll the
>> status of your running jobs.
>> On Mon, 27 Feb 2017 at 18:15 Mohit Anchlia <mohitanchlia@gmail.com>
>> wrote:
>> What's the best way to track the progress of the job?
>> On Mon, Feb 27, 2017 at 7:56 AM, Aljoscha Krettek <aljoscha@apache.org>
>> wrote:
>> Hi Mohit,
>> I'm afraid there is nothing like this in Flink yet. As you mentioned you
>> probably have to manually track the completion of one job and then trigger
>> execution of the next one.
>> Best,
>> Aljoscha
>> On Fri, 24 Feb 2017 at 19:16 Mohit Anchlia <mohitanchlia@gmail.com>
>> wrote:
>> Is there a way to connect 2 workflows such that one triggers the other if
>> certain condition is met? However, the workaround may be to insert a
>> notification in a topic to trigger another workflow. The problem is that
>> the addSink ends the flow so if we need to add a trigger after addSink
>> there doesn't seem to be any good way of sending a notification to a queue
>> that the batch processing is complete. Any suggestions? One option could be
>> track the progress of a job and on a successful completion add a
>> notification. Is there such a mechanism available?

View raw message