Return-Path: X-Original-To: apmail-zookeeper-user-archive@www.apache.org Delivered-To: apmail-zookeeper-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0FD0E10261 for ; Wed, 16 Oct 2013 20:12:42 +0000 (UTC) Received: (qmail 300 invoked by uid 500); 16 Oct 2013 20:12:39 -0000 Delivered-To: apmail-zookeeper-user-archive@zookeeper.apache.org Received: (qmail 161 invoked by uid 500); 16 Oct 2013 20:12:38 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Received: (qmail 149 invoked by uid 99); 16 Oct 2013 20:12:37 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 16 Oct 2013 20:12:37 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of lokimad@gmail.com designates 209.85.223.174 as permitted sender) Received: from [209.85.223.174] (HELO mail-ie0-f174.google.com) (209.85.223.174) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 16 Oct 2013 20:12:31 +0000 Received: by mail-ie0-f174.google.com with SMTP id qd12so2231864ieb.19 for ; Wed, 16 Oct 2013 13:12:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=Kb/6PqPfHd0JiO3m3NVF8AnxiSAVaJBq+xrAV0Dem20=; b=pJG+WMsWba0DkgS0Ptc/vbJFod885yI4pjOx8mFASELKPrSiJAFGzSxFvxeSLZ2yhM 1deDxNArRIpQO/GOZhVV6soUlHR1QYgd2M0XFP4YwkbDhpq6H9MX8cqEt7TN32D4XW+x kyq4/WpIcxP2POHktHrD/QzWGKKt0ba3LMFU08nupui23ljwFNwDloi8Yep1h2ih2DTy bkzLd34c/HudJdSz7tW2XG3PKE6FfjIQRDb7tUTohWSbpgMlWQCNCsGFRgPXjX6gmG2y NKhcm8vWBVb8LXCkl5+1r0TqO9VkcI646UrlvhB9faC6CJ12g+7Xqq2SeETThtKGR1zQ Eo8w== MIME-Version: 1.0 X-Received: by 10.50.61.179 with SMTP id q19mr23243383igr.33.1381954330569; Wed, 16 Oct 2013 13:12:10 -0700 (PDT) Received: by 10.64.227.105 with HTTP; Wed, 16 Oct 2013 13:12:10 -0700 (PDT) In-Reply-To: References: Date: Wed, 16 Oct 2013 17:12:10 -0300 Message-ID: Subject: Re: Best practices for using zookeeper in an Amazon EC2 environment From: Diego Oliveira To: user@zookeeper.apache.org Content-Type: multipart/alternative; boundary=047d7bdc109ef832f504e8e150a0 X-Virus-Checked: Checked by ClamAV on apache.org --047d7bdc109ef832f504e8e150a0 Content-Type: text/plain; charset=ISO-8859-1 Hello Bruce. I had the same IP issue last year but I can't remember exactly what I did but I think we used Elastic IPs. Another issue is the disk latency if you are using EBS and have a large datasheet to be load in case of restarts or network partition. On Wed, Oct 16, 2013 at 4:27 PM, Bruce Pennypacker < bruce.pennypacker@gmail.com> wrote: > We've started using an ensemble of 3 zookeepers in an EC2 environment to > support a solr cloud setup. I was wondering if anybody else has done so > and if they have any recommendations, especially pertaining to instance > sizes, DNS, etc. > > One particular question I have with regards to EC2: We had an issue a while > back where we had to reboot one of our zookeeper instances. Given the way > AWS works it meant the server was assigned a new IP address. Our current > configuration (generated automatically by an in-house tool) uses the IP > addresses of each server in the zookeeper configuration file. That led to > issues since the only way we could get the ensemble to recognize the > rebooted server was to restart all the zookeepers so that they got the new > IP of the rebooted instance. > > Given the nature of AWS and the likelihood that we'll need to reboot > another zookeeper server eventually, what is the best approach to defining > the hosts? Can local /etc/hosts files where the we can update the IP be > enough, or would we need to switch to using DNS for the zookeepers? I'm > guessing we might have to go the DNS route but I'm not 100% convinced. > > Thanks, > > -Bruce > -- Att. Diego de Oliveira System Architect diego@diegooliveira.com www.diegooliveira.com Never argue with a fool -- people might not be able to tell the difference --047d7bdc109ef832f504e8e150a0--