flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Maximilian Michels <...@apache.org>
Subject Re: Contact from site - Lou
Date Fri, 27 Mar 2015 12:29:21 GMT
Hi Lou,

Thanks for your interest in Apache Flink.

What exactly do you mean by "cluster/job manager"? Are you referring to a
cluster resource management environment like Hadoop YARN? Currently, Flink
has a standalone and a YARN execution mode. In the YARN case, cluster
resource allocation is handled by YARN. Flink instances are spawned on the
assigned resources. It should be possible to integrate a different resource
management into Flink although no effort has been dedicated so far to do
this in a systematic way.

By the way, Flink's component which is in charge of the scheduling and
monitoring Flink jobs is also called JobManager. Replacing this component
should be non-trivial because it is hardwired with Flink's execution logic.


On Fri, Mar 27, 2015 at 9:08 AM, Kostas Tzoumas <ktzoumas@apache.org> wrote:

> Hi,
> I am forwarding this question from Lou so that others can benefit as well.
> Kostas
> ---------- Forwarded message ----------
> From: <yue.lu@ericsson.com>
> Date: Thu, Mar 26, 2015 at 4:07 PM
> Hi there,
> I am Lou, a Ph.D. research scientist working at Ericsson Research (ER),
> Stockholm, Sweden.
> At first, many thanks for the presentation given by Kostas and Stephan at
> ER this Tuesday, about which I attended via telephone conference.
> Next, may I ask you a short question please? We are currently working with
> the development of an in-house cluster/job manager, and my question is: is
> it easy to test our own job manager on Apache Flink, and do you have any
> guidelines about doing it? Moreover, is the current standalone cluster
> manager called “direct” on Flink?
> Thanks in advance,
> Cheers,
> Lou

View raw message