kylin-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Henry Saputra <>
Subject Re: [DISCUSS] about cluster management
Date Mon, 02 Nov 2015 16:12:32 GMT
Why dont we just leverage Hadoop YARN?

We could use Apache Twill [1] to wrap it as YARN application.

Helix is great but one of the limitations it could not provision new
node when not already available.


On Sun, Nov 1, 2015 at 7:01 PM, ć‘šćƒæ˜Š <> wrote:
> Hi, all
>      Kylin currently manages the cluster itself, so far it works fine since
> there are only 2 roles for the cluster, job engine and query engine.
>      In order to reduce the complexity of deployment and support the coming
> streaming feature, I suggest kylin have a better cluster management.
>      There are several candidates I think can be leveraged. Apache Helix
> seem suitable for Kylin in my opinion.
>      I would love to start a discussion about cluster manager of Kylin, how
> we can do it the better way, and which component we should choose.

View raw message