Return-Path: X-Original-To: apmail-mesos-user-archive@www.apache.org Delivered-To: apmail-mesos-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2BA28183A0 for ; Mon, 28 Dec 2015 22:52:15 +0000 (UTC) Received: (qmail 6054 invoked by uid 500); 28 Dec 2015 22:52:14 -0000 Delivered-To: apmail-mesos-user-archive@mesos.apache.org Received: (qmail 5976 invoked by uid 500); 28 Dec 2015 22:52:14 -0000 Mailing-List: contact user-help@mesos.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@mesos.apache.org Delivered-To: mailing list user@mesos.apache.org Received: (qmail 5966 invoked by uid 99); 28 Dec 2015 22:52:14 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Dec 2015 22:52:14 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id E7E47C023A for ; Mon, 28 Dec 2015 22:52:13 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.002 X-Spam-Level: X-Spam-Status: No, score=0.002 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=mesosphere-com.20150623.gappssmtp.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id cjeXig3eN7go for ; Mon, 28 Dec 2015 22:51:59 +0000 (UTC) Received: from mail-lf0-f72.google.com (mail-lf0-f72.google.com [209.85.215.72]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id ED9DE203A3 for ; Mon, 28 Dec 2015 22:51:58 +0000 (UTC) Received: by mail-lf0-f72.google.com with SMTP id z124so126790661lfa.1 for ; Mon, 28 Dec 2015 14:51:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mesosphere-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=o/w6y5krqwDXynZsPFAepZWQ5fulyI9ECm8fWpwPxCc=; b=AvmcM8BNjT6KUYd+rgUjrUUBgLxKbCLqNbR2oBJESCj1z/g2bKCnXGzSm1iFkBYgMw VpfpzKxv51ac4I63+ptuShLGXyzdyZ8fFR6GhanmvGJtKNuIrNwAMEeACmIP09mSR30y rckdx9GwCCbUdCu5bpgZXYNihH9ZASQ1t54YZP+xzstxZa9WAT0+dHwfRuaxXjmB8T8o qn3n3iqfWr34yQeYb9dMfFDFNVgIIsdFO6/8jO/W46PwLZc2p+XXNhW7uRtfEiS/K4Bb Tv+98aVDutYjk+GDpDzgjFcCGxOFB5+8SdtiBn/PgOOTzq1VhjO6A1oLcs1CKimsWDsd mHbw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=o/w6y5krqwDXynZsPFAepZWQ5fulyI9ECm8fWpwPxCc=; b=a8kHyBKbDYXw1T6AlRJm7CXv++9zAz2tUg8LczBGTkgJhWNhZQzh/yNpsiTdCx1pE0 mHvpkHq10ftkszr7txwdCPx7q2rHqAVU6cThE7/V5dGuieHZnmNaECRlTrk+VV4oIMnw EOhmQm0tS62w0pLZ7mI2dfyvFiicxtXv63L9/ayg8smN3snzy+8kLcIrEpXgacnuL0dP EMqh2+64nXSAhO4p7VvWWAE1Ne5A6EKArLz+3QPZPzviYXG9p1cLcZFVE72r8L4RJQkc 7nK+ubXp2/eFr8PNltZkIus0y6ZC3GE1UeYjzjyI2/XJT/3ZbtpNCpnla29qzI6ohU14 SmBw== X-Gm-Message-State: ALoCoQnx6gy+yF7WchkYrC3bOuKhtFF/gjvDSSgHaUu3ESAtfmjzxwTOV8Jk0jTQHMs4FSPsynxi7vy4YBs8FgDgfShCqxzN0k4PmSgB8rJr6y15OmBY1QI= MIME-Version: 1.0 X-Received: by 10.28.94.1 with SMTP id s1mr59913601wmb.60.1451343118249; Mon, 28 Dec 2015 14:51:58 -0800 (PST) Received: by 10.194.24.198 with HTTP; Mon, 28 Dec 2015 14:51:58 -0800 (PST) In-Reply-To: References: <3D60EFBB-BE04-4236-8275-149FA16391E9@gmail.com> Date: Mon, 28 Dec 2015 23:51:58 +0100 Message-ID: Subject: Re: mesos-elasticsearch vs Elasticsearch with Marathon From: Alex Rukletsov To: user@mesos.apache.org Cc: Frank Scholten Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Craig, mind elaborating, how exactly do you run elasticsearch in Marathon? On Mon, Dec 28, 2015 at 8:36 PM, craig w wrote: > In terms of discovery, elasticsearch provides that out of the box > https://www.elastic.co/guide/en/elasticsearch/reference/1.4/modules-disco= very.html. > We deploy elasticsearch via Marathon and it works great. > > On Mon, Dec 28, 2015 at 2:17 PM, Eric LEMOINE wro= te: >> >> On Mon, Dec 28, 2015 at 7:55 PM, Alex Rukletsov >> wrote: >> > Eric=E2=80=94 >> > >> > give me a chance to answer that before you fall into frustration : ). >> > Also, you can directly write to framework developers >> > (mesos-es@container-solutions.com) and they either confirm or bust my >> > guess. Or maybe one of the authors =E2=80=94 Frank =E2=80=94 will chim= e in in this >> > thread. >> > >> > Marathon has no idea about application logic, hence a "scale" >> > operation just starts more application instances. But sometimes you >> > may want to do extra job (track instances, report ip:port of a new >> > instance to existing instances, and so on). That's when a dedicated >> > framework makes sense. Each framework has a scheduler that is able to >> > track each instance and do all aforementioned actions. >> > >> > How this maps to your question? AFAIK, all Elasticsearch nodes should >> > see each other, hence once a new node is started, it should be somehow >> > advertised to other nodes. You can do it by wrapping Elasticsearch >> > command in a shell script and maintain some sort of an out-of-band >> > registry, take a look at one of the first efforts [1] to run >> > Elasticsearch on Mesos to get an impression how it may look like. But >> > you can use a dedicated framework instead : ). >> > >> > [1] https://github.com/mesosphere/elasticsearch-mesos >> >> >> That makes great sense Alex. Thanks for chiming in. > > > > > -- > > https://github.com/mindscratch > https://www.google.com/+CraigWickesser > https://twitter.com/mind_scratch > https://twitter.com/craig_links