kylin-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adunuthula, Seshu" <sadunuth...@ebay.com>
Subject Re: [DISCUSS] about cluster management
Date Wed, 04 Nov 2015 13:05:47 GMT
Agree with that approach. Have an embedded Cluster Manager, but build
enough hooks to integrate with the popular cluster managers being deployed
in the enterpriseĊ 


On 11/4/15, 2:27 AM, "Li Yang" <liyang@apache.org> wrote:

>I think Spark has done this right. It can run by itself, and run on YARN
>or
>Mesos if needed. We should head in this direction.
>
>The first step is to enable a self-contained mode. In this case,
>lightweight lib + zookeeper is still most preferable. Helix and Curator
>are
>two good candidates here.
>
>Integrate with Mesos or YARN will be on future road map.
>
>
>On Tue, Nov 3, 2015 at 11:14 PM, Luke Han <luke.hq@gmail.com> wrote:
>
>> Would like to echo Yang's comments to keep dependency as minimal as
>> possible.
>> A self-contain one will let people easy to setup and manage Kylin
>>instance
>> as essential.
>>
>> And then we could extend a little bit to support other cluster
>>management
>> frameworks,
>> the key is how we could design the architecture to more plug-able way:)
>>
>> Thanks.
>>
>>
>> Best Regards!
>> ---------------------
>>
>> Luke Han
>>
>> On Tue, Nov 3, 2015 at 11:13 PM, Tero Paananen <teropaananen@gmail.com>
>> wrote:
>>
>> > Whatever the plan ends up being, please don't make it so that users
>> > will have to then manage the cluster manager.
>> >
>> > -TPP
>> >
>>


Mime
View raw message