Mailing-List: contact zookeeper-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: zookeeper-user@hadoop.apache.org
Received-SPF: neutral (athena.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; s=serpent; d=yahoo-inc.com; c=nofws; q=dns;
	h=received:user-agent:date:subject:from:to:message-id:
	thread-topic:thread-index:in-reply-to:mime-version:content-type:
	content-transfer-encoding:return-path:x-originalarrivaltime;
	b=hu7IasTq3d6ojzp63Yl36j/do9d1l4rF8662eIzfORePf3Ixda1bF51pEqdrB3gX
User-Agent: Microsoft-Entourage/12.15.0.081119
Date: Thu, 26 Feb 2009 11:10:12 -0800
Subject: Re: Anyone using Zookeeper in AWS (Amazon Cloud)?
From: Mahadev Konar <mahadev@yahoo-inc.com>
To: <zookeeper-user@hadoop.apache.org>
Message-ID: <C5CC2914.18C4C%mahadev@yahoo-inc.com>
Thread-Topic: Anyone using Zookeeper in AWS (Amazon Cloud)?
Thread-Index: AcmYRdkkn9OrAfxSR0CLTAmnWpCRmw==
In-Reply-To: <ecba2be10902261024k71435126jdafe48d205e3551b@mail.gmail.com>
Mime-version: 1.0
Content-type: text/plain;
	charset="US-ASCII"
Content-transfer-encoding: 7bit

Hi Greg,
  As for cross datacenters, we have tested zookeeper cross data centers and
it works fine. The only thing is that you might have to tweak synclimit and
tickTime to a little higher values for Zookeeper.

http://hadoop.apache.org/zookeeper/docs/r3.1.0/zookeeperAdmin.html#sc_config
uration provides documentation on these parameters.

As for communication protocol within zookeeper servers, we currently use raw
tcp sockets to send and receive data.  I cannot estimate the time it would
take the time for it to use https, but it wont be just a week of work for
sure.  Also, the client to zookeeper server is raw tcp again.

We would certainly like to have security in Zookeeper. Currently, Hadoop
Core is also working on getting security in place. We plan to have a similar
security model as theirs (I think they are looking at kerberos -- not sure)
.

mahadev

On 2/26/09 10:24 AM, "bebble zap" <beeblezap@gmail.com> wrote:

> We're thinking about using Zookeeper as our coordination service and
> also for doing group membership in the Amazon Cloud.  Currently our
> applications are deployed in Amazon Cloud on multiple availability
> zones (i.e. data centers), so this means that ZK nodes will be talking
> across datacenters.  I'm assuming that the additional latency from
> going across datacenters shouldn't be too big of an issue.  Also, we
> are paranoid about security in the cloud, so we'd like to use https as
> the communications protocol for Zookeeper -- not sure if this is a
> trivial thing to do or not.   Wondering if anyone's already doing this
> today or whether Zookeeper is not the right solution given our
> environment currently.
> 
> Thanks
> Greg