From dev-return-7498-archive-asf-public=cust-asf.ponee.io@airflow.apache.org Sun Jan 27 07:57:41 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 8F3CF180600 for ; Sun, 27 Jan 2019 07:57:40 +0100 (CET) Received: (qmail 43942 invoked by uid 500); 27 Jan 2019 06:57:39 -0000 Mailing-List: contact dev-help@airflow.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@airflow.apache.org Delivered-To: mailing list dev@airflow.apache.org Received: (qmail 43923 invoked by uid 99); 27 Jan 2019 06:57:38 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 27 Jan 2019 06:57:38 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id BB87F180867 for ; Sun, 27 Jan 2019 06:57:37 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.903 X-Spam-Level: X-Spam-Status: No, score=-0.903 tagged_above=-999 required=6.31 tests=[DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=protonmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id mwazwn6Ey95R for ; Sun, 27 Jan 2019 06:57:35 +0000 (UTC) Received: from mail-40135.protonmail.ch (mail-40135.protonmail.ch [185.70.40.135]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 8B17C5F57A for ; Sun, 27 Jan 2019 06:57:34 +0000 (UTC) Date: Sun, 27 Jan 2019 06:57:30 +0000 To: "dev@airflow.apache.org" From: airflowuser Reply-To: airflowuser Subject: Re: [DISCUSS]: Remove Mesos Executor from Airflow 2.0.0? Message-ID: In-Reply-To: References: <3F133B08-5EA9-47CD-A4F4-FFF0B263C7AE@gmail.com> Feedback-ID: UAaXdBXUnuMzujJRelKc4bDf5gBoFr1IfCgGsW9huQ3HA2brjGBWlgQ6D3cD2I-GuFbfBW6XXNV1B1KBmFmMBw==:Ext:ProtonMail MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable The Mesos executor is being used (at least by some people) and there is an = open PR to extend it: https://github.com/apache/airflow/pull/3739 Sent with ProtonMail Secure Email. =E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90 Original Me= ssage =E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90 On Friday, January 25, 2019 7:30 PM, Kaxil Naik wrote= : > What about Dask Executor as well. > > On Fri, Jan 25, 2019, 16:35 Daniel Imberman wrote: > > > @sid basically my response lol > > I haven't seen any emails from any users and if it's been broken for tw= o > > versions then there doesn't seem to be enough interest to maintain it. > > On Fri, Jan 25, 2019, 8:27 AM Sid Anand r39132@gmail.com wrote: > > > > > LOL :_0 > > > -s > > > On Fri, Jan 25, 2019 at 8:25 AM Bolke de Bruin bdbruin@gmail.com > > > wrote: > > > > > > > I agree. Maybe we should make a choice on what we consider 1st clas= s > > > > executors and move others to contrib (I'm looking at you celery) > > > > Sent from my iPhone > > > > > > > > > On 25 Jan 2019, at 12:46, Ash Berlin-Taylor ash@apache.org wrote: > > > > > Is anyone using the Mesos Executor? I think we should deprecate a= nd > > > > > remove it. > > > > > The reason I say that is I have a feeling it's been broken since > > > > > 1.9.0 > > > > > > > and no-one has noticed: > > > > > > > > > class MesosExecutor(BaseExecutor, LoginMixin): > > > > > def start(self): > > > > > # ... > > > > > self.log.info( > > > > > 'MesosFramework master : %s, name : %s, cpu : %s, mem : > > > > > %s, > > > > > > > checkpoint : %s', > > > > > > > > > master, framework.name, > > > > > str(task_cpu), str(task_memory), str(framework.checkpo= int) > > > > > ) > > > > > > > > > > > > > > > That mixin should have been LoggingMixin, not LoginMixin. But giv= en > > > > > this > > > > > bug has been in since > > > > https://github.com/apache/airflow/commit/a7a518902dcf1e7fd4bf477cf57cee= 691f181b29 > > > > > > which was in the 1.9.0 release I propose we simply remove this exec= utor > > > > from master. > > > > > > > > > Thoughts? > > > > > Ash