Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 907C3200D26 for ; Fri, 20 Oct 2017 12:16:11 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 8EF2A160BCB; Fri, 20 Oct 2017 10:16:11 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 35EAD1609E1 for ; Fri, 20 Oct 2017 12:16:10 +0200 (CEST) Received: (qmail 69321 invoked by uid 500); 20 Oct 2017 10:16:09 -0000 Mailing-List: contact dev-help@airflow.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@airflow.incubator.apache.org Delivered-To: mailing list dev@airflow.incubator.apache.org Received: (qmail 69309 invoked by uid 99); 20 Oct 2017 10:16:08 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Oct 2017 10:16:08 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id E381FC1013 for ; Fri, 20 Oct 2017 10:16:07 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.731 X-Spam-Level: ** X-Spam-Status: No, score=2.731 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.001, HTML_MESSAGE=2, KAM_LOTSOFHASH=0.25, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=driesprongen-nl.20150623.gappssmtp.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id WnKO0mndACov for ; Fri, 20 Oct 2017 10:16:03 +0000 (UTC) Received: from mail-wm0-f48.google.com (mail-wm0-f48.google.com [74.125.82.48]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id B60D05F566 for ; Fri, 20 Oct 2017 10:16:02 +0000 (UTC) Received: by mail-wm0-f48.google.com with SMTP id r68so1846177wmr.3 for ; Fri, 20 Oct 2017 03:16:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=driesprongen-nl.20150623.gappssmtp.com; s=20150623; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=2cIryP3OqxPgub2F3xlOQ4XHIz1F9RwddkZOAlwheP8=; b=rCr/3A4i4DuQtRd4EMX7NBF6ysn8qMkmUojR4sMZMyxLilOSqEc7d3srMMYVO4y7el Keb8n4znEawWbKoQjxXw7CjHxvh/Tm79oNB1FLDd6KwEFufWrqa0GWjZ0vOoDsvBRlNm taYGtGdIaE5xbKKKgCRmpJApiPx9PD8yv2XlEKnR7AO32ZVt4UCePTFPDozn/Hep5D3u r+muaEt+quNuF8Qe76cihR3NViLpdK1L3Z9QlP1JjJ2OMd3U0jXfSyOBSuuhsbw/9nCT 3XBmFAUPST4CIwQImdr9IKrhXgu7e8hBGhzV3slSQYo1M+3T+1jw7ujcr6GLPI8dx3jn iT1g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=2cIryP3OqxPgub2F3xlOQ4XHIz1F9RwddkZOAlwheP8=; b=odGcZ7/Di7tshJFVgGRoVI44ElzXUjDhWrglZO+xetNI3XtZ2sR1F8N9AOFAtcVf4j FF19ZEUFfYfgEem4KrchRRoJU4fcm3TBg8MbjZudV2FjluZB+GhB4bA+fOuGxNdEXsfX KcyUZ6mqgV/cUXFo6cPEReTp1VvIJ1rFGnGW3siCIhTQu34+blACLgHLCktMh73JdiE4 rtrB68p6QSkh8AMiEu/9tUMrIuZtXkVyoYZhRwH9ReO6JdusaIRx43rVfBVCQVzvEM5P hcAdy6d8GGE+m2FYIVhNzC4WEG6/JNkooSTrGYfx2tbQ1/o3uBcLFLxHw6MVD3S1FN9S ylLA== X-Gm-Message-State: AMCzsaUBiPst+nDKPJ/UCTdhqNTlAp6+JhtNqM0oJaZu/YNTE4h3Snhs LNEUjSIXEs2AqgwtF9eARjiHHPKhU7oKVVWZld9s/XGZ X-Google-Smtp-Source: ABhQp+RuoK9hKI9sikIEVsfY1vG0l981U33q1+uBh5ieEDN0/kONX/5gEP5jzzfAEDmCq329Sk69yQcrbyy1Ogu1ICQ= X-Received: by 10.80.135.219 with SMTP id 27mr5779036edz.203.1508494560867; Fri, 20 Oct 2017 03:16:00 -0700 (PDT) MIME-Version: 1.0 Sender: fokko@driesprongen.nl Received: by 10.80.170.9 with HTTP; Fri, 20 Oct 2017 03:16:00 -0700 (PDT) In-Reply-To: <2DD246D6-3206-448A-9A8A-3EBC51238D69@gmail.com> References: <5BAF92AE-C6A0-4BCD-98DA-ADA08F8EE1BC@gmail.com> <698D530F-2A55-432A-A874-174E7D8C9C45@modernizingmedicine.com> <21E72193-A2C9-4950-A269-A9FFF9C81407@gmail.com> <8EFB9654-E4C5-443F-AECC-5479211985BE@gmail.com> <2DD246D6-3206-448A-9A8A-3EBC51238D69@gmail.com> From: "Driesprong, Fokko" Date: Fri, 20 Oct 2017 12:16:00 +0200 X-Google-Sender-Auth: 3CskqQ_lTKlfdTQJHrWKxu0PWE8 Message-ID: Subject: Re: Airflow 1.9.0 status To: dev@airflow.incubator.apache.org Cc: Chris Riccomini Content-Type: multipart/alternative; boundary="f403045c1276725398055bf7c213" archived-at: Fri, 20 Oct 2017 10:16:11 -0000 --f403045c1276725398055bf7c213 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Bolke, This one is a blocker: https://issues.apache.org/jira/browse/AIRFLOW-1731. This requirers that we are sure that the /plugin/ folder is on the path: https://github.com/apache/incubator-airflow/blob/eb2f589099b87743482c2eb162= 61b49e284dcd96/airflow/plugins_manager.py And maybe add an additional test and updating the docs a bit. Hopefully somewhere in the next few days, however I'm a bit busy with the Spark Summit. Cheers, Fokko 2017-10-19 21:03 GMT+02:00 Bolke de Bruin : > Im planning to upgrade our production to 1.9.0alphaX tomorrow. > > What are the issues that are open? > > Cheers > Bolke > > > On 9 Oct 2017, at 20:24, Chris Riccomini wrote: > > > > K, I will plan on cutting an alpha1 later this week. Something for you > guys to play with. > > > > On Mon, Oct 9, 2017 at 11:23 AM, Bolke de Bruin > wrote: > > hi Chris, > > > > We are still running pre alpha. I am a bit preoccupied with preparing > for a conference and the team is readying a release of one of our core > products. So it will probably will be after this week when I get my hands > dirty again. > > > > Cheers > > Bolke > > > > Verstuurd vanaf mijn iPad > > > > > Op 4 okt. 2017 om 23:35 heeft Chris Riccomini > het volgende geschreven: > > > > > > Hey all, > > > > > > Checking in. Has anyone tested this in their environments? Stable > releases > > > depend on community involvement. > > > > > > Cheers, > > > Chris > > > > > > On Tue, Oct 3, 2017 at 10:30 PM, Chris Riccomini < > criccomini@apache.org > > > > wrote: > > > > > >> I've added AIRFLOW-1635 to the v1-9-test branch. It's not in alpha0, > but > > >> will be included in alpha1. > > >> > > >>> On Tue, Oct 3, 2017 at 4:13 PM, Feng Lu > wrote: > > >>> > > >>> Hi Chris, > > >>> > > >>> I know it's annoying to have last minute commit com in, but this is= a > > >>> highly desirable feature for folks using GCP operators, is it > possible to > > >>> include AIRFLOW-1635 > > >>> https://github.com/apache/incubator-airflow/commit/b3e985a3> > > >>> 146272ecfd3ceaaa0d8567e4e9e117d4> > > >>> in? > > >>> More than happy to offer help if there's something I can do. > > >>> Thanks a lot. > > >>> > > >>> Feng > > >>> > > >>> On Mon, Oct 2, 2017 at 3:24 PM, Chris Riccomini < > criccomini@apache.org > > > >>> wrote: > > >>> > > >>>> Hey all, > > >>>> > > >>>> I have cut a 1.9.0alpha0 release of Airflow. You can download it > here: > > >>>> > > >>>> https://dist.apache.org/repos/dist/dev/incubator/airflow/1. > 9.0alpha0/ airflow/1.9.0alpha0/> > > >>>> > > >>>> The bin tarball can be installed with pip: > > >>>> > > >>>> pip install apache-airflow-1.9.0alpha0+incubating-bin.tar.gz > > >>>> > > >>>> The goal is to have the community install and run this to expose a= ny > > >>> bugs > > >>>> before we move on to official release candidates. > > >>>> > > >>>> Here are the outstanding blocker bugs for 1.9.0: > > >>>> > > >>>> AIRFLOW-1525 |Improvement |Fix minor LICENSE & NOTICE issue > > >>>> AIRFLOW-1258 |Bug |TaskInstances within SubDagOperator ar= e > > >>> marked > > >>>> as > > >>>> AIRFLOW-1055 |Bug |airflow/jobs.py:create_dag_run() > exception > > >>>> for > > >>>> @on > > >>>> AIRFLOW-1018 |Bug |Scheduler DAG processes can not log to > > >>> stdout > > >>>> AIRFLOW-1013 |Bug |airflow/jobs.py:manage_slas() exceptio= n > > >>> for > > >>>> @once > > >>>> AIRFLOW-976 |Bug |Mark success running task causes it to > fail > > >>>> > > >>>> Cheers, > > >>>> Chris > > >>>> > > >>>> On Fri, Sep 29, 2017 at 3:54 PM, Chris Riccomini < > criccomini@apache.org > > >>>> > > >>>> wrote: > > >>>> > > >>>>> Welp. Work got in the way, so I'll cut the beta on Monday. :) > > >>>>> > > >>>>> On Thu, Sep 28, 2017 at 1:32 PM, Chris Riccomini < > > >>> criccomini@apache.org > > > >>>>> wrote: > > >>>>> > > >>>>>> Works for me. Will try and cut a beta before end of week. > > >>>>>> > > >>>>>> Blockers for 1.9.0 are: > > >>>>>> > > >>>>>> AIRFLOW-1611 |Bug |Customize logging in Airflow > > >>>>>> AIRFLOW-1525 |Improvement |Fix minor LICENSE & NOTICE issue > > >>>>>> AIRFLOW-1258 |Bug |TaskInstances within SubDagOperator a= re > > >>>> marked > > >>>>>> as > > >>>>>> AIRFLOW-976 |Bug |Mark success running task causes it t= o > > >>> fail > > >>>>>> > > >>>>>> > > >>>>>> On Thu, Sep 28, 2017 at 1:09 PM, Bolke de Bruin < > bdbruin@gmail.com > > > >>>>>> wrote: > > >>>>>> > > >>>>>>> Hi Chris > > >>>>>>> > > >>>>>>> Can I suggest releasing a beta? The stable branch is only cut a= t > RC > > >>>>>>> time. Betas allow us a broader exposure. It also gives us a > point of > > >>>>>>> reference. > > >>>>>>> > > >>>>>>> In addition the list below are mostly longer standing issues th= at > > >>> are > > >>>>>>> also part of the 1.8.x branch. Maybe only consider 1611, 1525, > 1258, > > >>>> and > > >>>>>>> 976 as blocker? > > >>>>>>> > > >>>>>>> Cheers > > >>>>>>> Bolke > > >>>>>>> > > >>>>>>> Verstuurd vanaf mijn iPad > > >>>>>>> > > >>>>>>>> Op 28 sep. 2017 om 19:49 heeft Chris Riccomini < > > >>>> criccomini@apache.org > > > >>>>>>> het volgende geschreven: > > >>>>>>>> > > >>>>>>>> Hey all, > > >>>>>>>> > > >>>>>>>> I was planning to cut a 1.9.0 stable branch and 1.9.0 beta > > >>> release, > > >>>> but > > >>>>>>>> seeing as there are several outstanding bugs, I'm going to > delay. > > >>>> Here > > >>>>>>> are > > >>>>>>>> the bugs that I'm tracking: > > >>>>>>>> > > >>>>>>>> AIRFLOW-1611 |Bug |Customize logging in Airflow > > >>>>>>>> AIRFLOW-1525 |Improvement |Fix minor LICENSE & NOTICE issue > > >>>>>>>> AIRFLOW-1258 |Bug |TaskInstances within SubDagOperator > are > > >>>>>>> marked as > > >>>>>>>> AIRFLOW-1055 |Bug |airflow/jobs.py:create_dag_run() > > >>>> exception > > >>>>>>> for > > >>>>>>>> @on > > >>>>>>>> AIRFLOW-1018 |Bug |Scheduler DAG processes can not log > to > > >>>>>>> stdout > > >>>>>>>> AIRFLOW-1013 |Bug |airflow/jobs.py:manage_slas() > > >>> exception > > >>>>>>> for @once > > >>>>>>>> AIRFLOW-988 |Bug |SLA Miss Callbacks Are Repeated if > > >>> Email > > >>>> is > > >>>>>>> Not > > >>>>>>>> be > > >>>>>>>> AIRFLOW-976 |Bug |Mark success running task causes it > to > > >>>> fail > > >>>>>>>> > > >>>>>>>> These are the priority issues. Once they're merged, I'll cut t= he > > >>>>>>>> v1-9-stable and beta release. > > >>>>>>>> > > >>>>>>>> If you can help clean this up, that would be really appreciate= d. > > >>>>>>>> > > >>>>>>>> Cheers, > > >>>>>>>> Chris > > >>>>>>>> > > >>>>>>>> On Thu, Sep 28, 2017 at 10:06 AM, Chris Riccomini < > > >>>>>>> criccomini@apache.org > > > >>>>>>>> wrote: > > >>>>>>>> > > >>>>>>>>> Marked it for 1.9.0. > > >>>>>>>>> > > >>>>>>>>>> On Thu, Sep 28, 2017 at 9:56 AM, Charlie Jones < > > >>> cjones@simpli.fi > > > >>>>>>> wrote: > > >>>>>>>>>> > > >>>>>>>>>> Is there any chance we could include AIRFLOW-988 in 1.9.0? S= LA > > >>>>>>> callbacks > > >>>>>>>>>> are not working correctly without emails... Its not a major > bug, > > >>>> but > > >>>>>>> it > > >>>>>>>>>> does cause us some annoyance in our current deployment. > > >>>>>>>>>> > > >>>>>>>>>> Link to Jira: > > >>>>>>>>>> https://issues.apache.org/jira/browse/AIRFLOW-988 < > https://issues.apache.org/jira/browse/AIRFLOW-988> > > >>>>>>>>>> > > >>>>>>>>>> Link to PR: > > >>>>>>>>>> https://github.com/apache/incubator-airflow/pull/2415 < > https://github.com/apache/incubator-airflow/pull/2415> > > >>>>>>>>>> > > >>>>>>>>>> Thanks! > > >>>>>>>>>> Charlie Jones > > >>>>>>>>>> > > >>>>>>>>>> CHARLIE JONES > > >>>>>>>>>> Data Engineer > > >>>>>>>>>> cjones@simpli.fi | M: > 972.821.7631 > > >>>>>>>>>> __________________________________________________ > > >>>>>>>>>> > > >>>>>>>>>> > > >>>>>>>>>> Programmatic Performance.* Localized.* > > >>>>>>>>>> __________________________________________________ > > >>>>>>>>>> > > >>>>>>>>>> 1407 Texas Street | Suite 202 | Fort Worth, TX 76102 > > >>>>>>>>>> 800.840.0768 | www.simpli.fi < > http://www.simpli.fi/> > > >>>>>>>>>> > > >>>>>>>>>> > > >>>>>>>>>> On Wed, Sep 27, 2017 at 12:11 PM, Chris Riccomini < > > >>>>>>> criccomini@apache.org > > > >>>>>>>>>> wrote: > > >>>>>>>>>> > > >>>>>>>>>>> Merged. > > >>>>>>>>>>> > > >>>>>>>>>>> On Tue, Sep 26, 2017 at 2:25 PM, Ryan Buckley < > > >>>>>>>>>> ryan.buckley@bluecore.com = > > > >>>>>>>>>>> wrote: > > >>>>>>>>>>> > > >>>>>>>>>>>> Would it be possible to include AIRFLOW-1587? > > >>>>>>>>>>>> Running dags from the UI is currently broken on the 1.9.0 > > >>> branch > > >>>>>>> due > > >>>>>>>>>> to > > >>>>>>>>>>>> this issue. > > >>>>>>>>>>>> > > >>>>>>>>>>>> https://github.com/apache/incubator-airflow/pull/2590 < > https://github.com/apache/incubator-airflow/pull/2590> > > >>>>>>>>>>>> > > >>>>>>>>>>>> Thanks, > > >>>>>>>>>>>> Ryan > > >>>>>>>>>>>> > > >>>>>>>>>>>> On Tue, Sep 26, 2017 at 8:14 AM, Driesprong, Fokko > > >>>>>>>>>> > >>>>>>>>>>>> > > >>>>>>>>>>>> wrote: > > >>>>>>>>>>>> > > >>>>>>>>>>>>> Hi All, > > >>>>>>>>>>>>> > > >>>>>>>>>>>>> I would like to include AIRFLOW-1611 in the 1.9.0 release= : > > >>>>>>>>>>>>> https://github.com/apache/incubator-airflow/pull/2631 < > https://github.com/apache/incubator-airflow/pull/2631> > > >>>>>>>>>>>>> > > >>>>>>>>>>>>> Currently importing a custom logging configuration is not > > >>> work > > >>>> (as > > >>>>>>>>>> far > > >>>>>>>>>>>> as I > > >>>>>>>>>>>>> know). Any feedback on the PR would also be appreciated. > > >>>>>>>>>>>>> > > >>>>>>>>>>>>> Cheers, Fokko > > >>>>>>>>>>>>> > > >>>>>>>>>>>>> > > >>>>>>>>>>>>> 2017-09-25 23:27 GMT+02:00 Chris Riccomini < > > >>>> criccomini@apache.org > > >>>>>>>> : > > >>>>>>>>>>>>> > > >>>>>>>>>>>>>> Done! > > >>>>>>>>>>>>>> > > >>>>>>>>>>>>>> On Mon, Sep 25, 2017 at 5:11 AM, Michael Crawford < > > >>>>>>>>>>>>>> michael.crawford@modernizingmedicine.com michael.crawford@modernizingmedicine.com>> wrote: > > >>>>>>>>>>>>>> > > >>>>>>>>>>>>>>> Can you slide the aws and emr connection type fix in? > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>> https://issues.apache.org/jira/browse/AIRFLOW-1636 < > https://issues.apache.org/jira/browse/AIRFLOW-1636> < > > >>>>>>>>>>>>>>> https://issues.apache.org/jira/browse/AIRFLOW-1636 < > https://issues.apache.org/jira/browse/AIRFLOW-1636>> > > >>>>>>>>>>>>>>> https://github.com/apache/incubator-airflow/pull/2626 < > https://github.com/apache/incubator-airflow/pull/2626> < > > >>>>>>>>>>>>>>> https://github.com/apache/incubator-airflow/pull/2626 < > https://github.com/apache/incubator-airflow/pull/2626>> > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>> It keeps the connection type from getting blanked out o= n > > >>> edit > > >>>>>>>>>> for > > >>>>>>>>>>>> these > > >>>>>>>>>>>>>>> types. > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>> Thanks, > > >>>>>>>>>>>>>>> Mike > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>> On Sep 21, 2017, at 1:27 PM, Chris Riccomini < > > >>>>>>>>>>>> criccomini@apache.org > > > >>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>> Absolutely. Just cherry-picked. I've been looking > forward > > >>> to > > >>>>>>>>>>> these > > >>>>>>>>>>>>>> fixes! > > >>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>> On Wed, Sep 20, 2017 at 5:23 PM, Alex Guziel < > > >>>>>>>>>>>> alex.guziel@airbnb.com > > >>>>>>>>>>>>> . > > >>>>>>>>>>>>>>> invalid > > >>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> Can we get this in? > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> https://issues.apache.org/jira/browse/AIRFLOW-1519 < > https://issues.apache.org/jira/browse/AIRFLOW-1519> > > >>>>>>>>>>>>>>>>> https://issues.apache.org/jira/browse/AIRFLOW-1621 < > https://issues.apache.org/jira/browse/AIRFLOW-1621> > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> https://github.com/apache/incubator-airflow/commit/ < > https://github.com/apache/incubator-airflow/commit/> > > >>>>>>>>>>>>>>>>> b6d2e0a46978e93e16576604624f57d1388814f2 > > >>>>>>>>>>>>>>>>> https://github.com/apache/incubator-airflow/commit/ < > https://github.com/apache/incubator-airflow/commit/> > > >>>>>>>>>>>>>>>>> 656d045e90bf67ca484a3778b2a07a419bfb324a > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> It speeds up loading times a lot, so it's a good thin= g > to > > >>>>>>>>>> have > > >>>>>>>>>>> in > > >>>>>>>>>>>>> 1.9. > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> On Wed, Sep 20, 2017 at 11:14 AM, Chris Riccomini < > > >>>>>>>>>>>>>>> criccomini@apache.org > > > >>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>> Sounds good. I'll plan on stable+beta next week, the= n. > > >>>>>>>>>> Initial > > >>>>>>>>>>>>>> warning > > >>>>>>>>>>>>>>>>>> stands, that I will start locking down what can get > into > > >>>>>>>>>> 1.9.0 > > >>>>>>>>>>> at > > >>>>>>>>>>>>>> that > > >>>>>>>>>>>>>>>>>> point. > > >>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>> On Wed, Sep 20, 2017 at 11:10 AM, Bolke de Bruin < > > >>>>>>>>>>>>> bdbruin@gmail.com > > > >>>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> No vote indeed, just to gather feedback on a > particular > > >>>>>>>>>> fixed > > >>>>>>>>>>>>> point > > >>>>>>>>>>>>>> in > > >>>>>>>>>>>>>>>>>>> time. It also gives a bit more trust to a tarball > than > > >>> to > > >>>> a > > >>>>>>>>>>> git > > >>>>>>>>>>>>>> pull. > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> Bolke > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>> On 20 Sep 2017, at 20:09, Chris Riccomini < > > >>>>>>>>>>>> criccomini@apache.org > > >>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>> I can do a beta. Is the process significantly > > >>> different? > > >>>>>>>>>>> IIRC, > > >>>>>>>>>>>>> it's > > >>>>>>>>>>>>>>>>>>>> basically the same, just no vote, right? > > >>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>> On Wed, Sep 20, 2017 at 10:56 AM, Bolke de Bruin < > > >>>>>>>>>>>>>> bdbruin@gmail.com > > > >>>>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> Are you sure you want to go ahead and do RCs righ= t > > >>> away? > > >>>>>>>>>>>> Isn=E2=80=99t a > > >>>>>>>>>>>>>>>>> beta > > >>>>>>>>>>>>>>>>>> a > > >>>>>>>>>>>>>>>>>>>>> bit smarter? > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> - Bolke > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>> On 20 Sep 2017, at 19:41, Chris Riccomini < > > >>>>>>>>>>>>> criccomini@apache.org > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>> Hey all, > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>> I want to send out a warning that I'm planning t= o > > >>> cut > > >>>>>>>>>> the > > >>>>>>>>>>>>> stable > > >>>>>>>>>>>>>>>>>> branch > > >>>>>>>>>>>>>>>>>>>>>> next week, and begin the RC1 release vote. Once > the > > >>>>>>>>>> stable > > >>>>>>>>>>>>> branch > > >>>>>>>>>>>>>>>>> is > > >>>>>>>>>>>>>>>>>>>>> cut, I > > >>>>>>>>>>>>>>>>>>>>>> will be locking down what commits get cherry > picked > > >>>> into > > >>>>>>>>>>> the > > >>>>>>>>>>>>>>>>> branch, > > >>>>>>>>>>>>>>>>>>> and > > >>>>>>>>>>>>>>>>>>>>>> will only be doing PRs that are required to get > the > > >>>>>>>>>> release > > >>>>>>>>>>>>> out. > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>> Cheers, > > >>>>>>>>>>>>>>>>>>>>>> Chris > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>> On Mon, Sep 18, 2017 at 11:19 AM, Chris Riccomin= i > < > > >>>>>>>>>>>>>>>>>>> criccomini@apache.org > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>> wrote: > > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>> Hey all, > > >>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>> An update on the 1.9.0 release. Here are the > > >>>>>>>>>> outstanding > > >>>>>>>>>>> PRs > > >>>>>>>>>>>>>> that > > >>>>>>>>>>>>>>>>>> are > > >>>>>>>>>>>>>>>>>>>>>>> slated to be included into 1.9.0: > > >>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>> ISSUE ID |STATUS |DESCRIPTION > > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1617 |Open |XSS Vulnerability in > > >>> Variable > > >>>>>>>>>>>>> endpoint > > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1611 |Open |Customize logging in > > >>> Airflow > > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1605 |Reopened |Fix log source of loca= l > > >>>>>>>>>> loggers > > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1604 |Open |Rename the logger to l= og > > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1525 |Open |Fix minor LICENSE & > NOTICE > > >>>>>>>>>> issue > > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1499 |In Progres|Eliminate duplicate an= d > > >>>>>>>>>> unneeded > > >>>>>>>>>>>> code > > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1198 |Open |HDFSOperator to operat= e > > >>> HDFS > > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1055 |Open > > >>> |airflow/jobs.py:create_dag_ru > > >>>>>>>>>> n() > > >>>>>>>>>>>>>>>>> exception > > >>>>>>>>>>>>>>>>>>> for > > >>>>>>>>>>>>>>>>>>>>>>> @on > > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1019 |Open |active_dagruns shouldn= 't > > >>>>>>>>>> include > > >>>>>>>>>>>>> paused > > >>>>>>>>>>>>>>>>>> DAGs > > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1018 |Open |Scheduler DAG processe= s > > >>> can > > >>>>>>>>>> not > > >>>>>>>>>>> log > > >>>>>>>>>>>>> to > > >>>>>>>>>>>>>>>>>> stdout > > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1015 |Open |TreeView displayed ove= r > > >>> task > > >>>>>>>>>>>>> instances > > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1013 |Open > > >>> |airflow/jobs.py:manage_slas() > > >>>>>>>>>>>>> exception > > >>>>>>>>>>>>>>>>> for > > >>>>>>>>>>>>>>>>>>>>>>> @once > > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-976 |Open |Mark success running > task > > >>>>>>>>>> causes > > >>>>>>>>>>> it > > >>>>>>>>>>>>> to > > >>>>>>>>>>>>>>>>> fail > > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-914 |Open |Refactor > > >>>>>>>>>>>>> BackfillJobTest.test_backfill_ > > >>>>>>>>>>>>>>>>>>>>> examples > > >>>>>>>>>>>>>>>>>>>>>>> to > > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-913 |Open |Refactor > > >>>>>>>>>>>>> tests.CoreTest.test_scheduler_ > > >>>>>>>>>>>>>>>>> job > > >>>>>>>>>>>>>>>>>>> to > > >>>>>>>>>>>>>>>>>>>>>>> real > > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-912 |Open |Refactor tests and bui= ld > > >>>>>>>>>> matrix > > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-888 |Open |Operators should not > push > > >>>>>>>>>> XComs > > >>>>>>>>>>> by > > >>>>>>>>>>>>>>>>> default > > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-828 |Open |Add maximum size for > XComs > > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-825 |Open |Add Dataflow semantics > > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-788 |Open |Context unexpectedly > > >>> added to > > >>>>>>>>>>> hive > > >>>>>>>>>>>>> conf > > >>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>> I will be locking down what can get cherry-pick= ed > > >>> into > > >>>>>>>>>> the > > >>>>>>>>>>>>> 1.9.0 > > >>>>>>>>>>>>>>>>>>> branch > > >>>>>>>>>>>>>>>>>>>>>>> shortly, so if you have something you want in, > > >>> please > > >>>>>>>>>> set > > >>>>>>>>>>>> the > > >>>>>>>>>>>>>> fix > > >>>>>>>>>>>>>>>>>>>>> version > > >>>>>>>>>>>>>>>>>>>>>>> to 1.9.0. > > >>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>> We (at WePay) have deployed 1.9.0 into our dev > > >>>> cluster, > > >>>>>>>>>>> and > > >>>>>>>>>>>> it > > >>>>>>>>>>>>>> has > > >>>>>>>>>>>>>>>>>>> been > > >>>>>>>>>>>>>>>>>>>>>>> running smoothly for several days. > > >>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>> ** I could really use help verifying stability. > If > > >>> you > > >>>>>>>>>> run > > >>>>>>>>>>>>>>>>> Airflow, > > >>>>>>>>>>>>>>>>>>> it's > > >>>>>>>>>>>>>>>>>>>>>>> in your best interest to deploy the 1.9.0 test > > >>> branch > > >>>>>>>>>>>>> somewhere, > > >>>>>>>>>>>>>>>>> and > > >>>>>>>>>>>>>>>>>>>>> verify > > >>>>>>>>>>>>>>>>>>>>>>> it's working for your workload. ** > > >>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>> Cheers, > > >>>>>>>>>>>>>>>>>>>>>>> Chris > > >>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>> > > >>>>>>>>>>>>>> > > >>>>>>>>>>>>> > > >>>>>>>>>>>> > > >>>>>>>>>>> > > >>>>>>>>>> > > >>>>>>>>> > > >>>>>>>>> > > >>>>>>> > > >>>>>> > > >>>>>> > > >>>>> > > >>>> > > >>> > > >> > > >> > > > > --f403045c1276725398055bf7c213--