flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Flavio Pompermaier <pomperma...@okkam.it>
Subject Re: Flink Queue Scheduling (JobManager)
Date Wed, 27 Apr 2016 12:13:58 GMT
That would be definitely interesting but I think that at the moment the
only way to achieve that is to exploit YARN for that..
An integration with some job-workflow engine (like Apache Oozie and Apache
Falcon) would also be very useful! I tried to wrote on Apache Oozie mailing
list if there is any interest in integrating with apache Flink but I didn't
receive any feedback yet :(


On Wed, Apr 27, 2016 at 1:00 PM, Vikram Saxena <vikram.mbt@gmail.com> wrote:

> Hi
> I am reading and learning about Flink and I have tried to implement some
> Flink Jobs.
> In my application I have 2 Flink Jobs which I want to run in parallel.
> Of course, as I understand I can have the task slots divided so that each
> one can run concurrently.
> But, is there a possibility for scheduling jobs only to be processed when
> the JobManager has resources free(task slots) and not throw back
> (NoResourceAvailableException) ??
> The reason I ask this is because I have 2 Flink Jobs, one which would be
> always running in short intervals and other which would be in ad hoc basis.
> I do not want to have my task slots divided just for this ad hoc job,
> So I wanted to submit this adhoc job and the Job Manager can schedule it
> whenever it has free task slots ?
> Cheers,
> Vikram

View raw message