Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 0AC6D200D34 for ; Fri, 3 Nov 2017 22:59:38 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 09147160BFB; Fri, 3 Nov 2017 21:59:38 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 566A1160BDE for ; Fri, 3 Nov 2017 22:59:36 +0100 (CET) Received: (qmail 87977 invoked by uid 500); 3 Nov 2017 21:59:35 -0000 Mailing-List: contact dev-help@airflow.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@airflow.incubator.apache.org Delivered-To: mailing list dev@airflow.incubator.apache.org Received: (qmail 87966 invoked by uid 99); 3 Nov 2017 21:59:35 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Nov 2017 21:59:35 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 3425D1A02C2 for ; Fri, 3 Nov 2017 21:59:34 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -2.272 X-Spam-Level: X-Spam-Status: No, score=-2.272 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=2, KAM_LOTSOFHASH=0.25, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id nlmjOtUiL0mY for ; Fri, 3 Nov 2017 21:59:21 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with SMTP id B74065FC38 for ; Fri, 3 Nov 2017 21:59:20 +0000 (UTC) Received: (qmail 87049 invoked by uid 99); 3 Nov 2017 21:59:20 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Nov 2017 21:59:20 +0000 Received: from mail-oi0-f54.google.com (mail-oi0-f54.google.com [209.85.218.54]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id ED7D91A0117 for ; Fri, 3 Nov 2017 21:59:18 +0000 (UTC) Received: by mail-oi0-f54.google.com with SMTP id f66so3210737oib.2 for ; Fri, 03 Nov 2017 14:59:17 -0700 (PDT) X-Gm-Message-State: AMCzsaX8Ao9p0jSsxkHAYEb0TnWt0DyhLVSfCvnq+jOXVC8NrLTAI9jb 1K+ieJqQB1XO2UvCr547NfH401RIADCQIEO2/90= X-Google-Smtp-Source: ABhQp+SI2reTIIaueOtNrYDja89x6XRG6etpBG8HxYnKlFi/cofGQHm9TZUfU0RjNkT3CqFsFSHrffe48xC/j/ChQ+0= X-Received: by 10.202.228.3 with SMTP id b3mr4483048oih.243.1509746356242; Fri, 03 Nov 2017 14:59:16 -0700 (PDT) MIME-Version: 1.0 Received: by 10.74.108.71 with HTTP; Fri, 3 Nov 2017 14:59:15 -0700 (PDT) In-Reply-To: References: <5ACE8290-8B85-4CAD-9D4F-35C9C2690A91@gmail.com> <8913FD5DBE68DC4C83AE83264F30217D7E3D13B0@IRSMSX106.ger.corp.intel.com> From: Chris Riccomini Date: Fri, 3 Nov 2017 14:59:15 -0700 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Airflow 1.9.0 status To: dev@airflow.incubator.apache.org Content-Type: multipart/alternative; boundary="001a1141bd6a43cef6055d1b37b0" archived-at: Fri, 03 Nov 2017 21:59:38 -0000 --001a1141bd6a43cef6055d1b37b0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Lol, so sorry. It's going to slip to Monday. Today got busy, and we just deployed latest v1-9-test to prd. Wanted to let it run over the weekend. Sorry for the delay. Monday (or weekend, if I'm motivated). On Fri, Nov 3, 2017 at 2:49 PM, Bolke de Bruin wrote: > Will we get it before the weekend? Oh the suspense ;-) > > Sent from my iPhone > > > On 2 Nov 2017, at 17:17, Chris Riccomini wrote: > > > > @mC, yes it will. > > > > @Bolke, awesome! Will cut an RC today/tomorrow. :) Very exciting. > > > > On Thu, Nov 2, 2017 at 8:53 AM, Cieplucha, Michal < > > michal.cieplucha@intel.com> wrote: > > > >> Hello, > >> > >> Will this: > >> [AIRFLOW-1641] Handle executor events in the scheduler > >> https://github.com/apache/incubator-airflow/commit/ > >> 2abead7049806482047e29d123a109b444c00355 > >> > >> be included in 1.9? > >> > >> mC > >> > >> -----Original Message----- > >> From: Bolke de Bruin [mailto:bdbruin@gmail.com] > >> Sent: Wednesday, November 1, 2017 11:42 PM > >> To: dev@airflow.incubator.apache.org > >> Subject: Re: Airflow 1.9.0 status > >> > >> I think we are ready for RC. > >> > >> Bolke > >> > >> > >>> On 31 Oct 2017, at 21:30, Chris Riccomini > wrote: > >>> > >>> Great, sounds like this is the last remaining JIRA, then? > >>> > >>> https://issues.apache.org/jira/browse/AIRFLOW-1764 > >>> > >>> On Tue, Oct 31, 2017 at 11:23 AM, Bolke de Bruin > >> wrote: > >>> > >>>> Already fixed. > >>>> > >>>>> On 31 Oct 2017, at 18:49, Andy Hadjigeorgiou > >>>> wrote: > >>>>> > >>>>> Is this bug issue on DAG scheduling > >>>>> something that > >>>> needs > >>>>> resolution before the RC? > >>>>> > >>>>> On Tue, Oct 31, 2017 at 1:17 PM, Chris Riccomini > >>>>> > >>>>> wrote: > >>>>> > >>>>>> Both blockers have been merged. Are we ready for an RC? > >>>>>> > >>>>>> On Mon, Oct 30, 2017 at 11:55 AM, Bolke de Bruin > >>>>>> > >>>>>> wrote: > >>>>>> > >>>>>>> AIRFLOW-1764 is design/integration mistake (maybe worth a CVE). > >>>>>>> But > >>>> 1765 > >>>>>>> is not a vulnerability, although *maybe* unexpected behaviour. > >>>>>>> > >>>>>>> Bolke. > >>>>>>> > >>>>>>> > >>>>>>>> On 30 Oct 2017, at 19:51, Chris Riccomini > >>>>>> wrote: > >>>>>>>> > >>>>>>>> I marked them as blocker. Still would like to understand how > >>>>>>>> important > >>>>>>> this > >>>>>>>> is, though. The API is experimental, so I could see an argument > >>>>>>>> for > >>>>>> them > >>>>>>>> not being blocker provided the vulnerability is limited to > >>>> experimental > >>>>>>>> areas. > >>>>>>>> > >>>>>>>> On Mon, Oct 30, 2017 at 11:06 AM, Ash Berlin-Taylor < > >>>>>> ash@firemirror.com> > >>>>>>>> wrote: > >>>>>>>> > >>>>>>>>> I think we need to add > >>>>>>>>> > >>>>>>>>> https://issues.apache.org/jira/browse/AIRFLOW-1764 > >>>>>>>>> https://issues.apache.org/jira/browse/AIRFLOW-1765 > >>>>>>>>> > >>>>>>>>> to that list as critical security fixes. I'll tackled 1765 > >>>>>>>>> tomorrow > >>>>>> (UK > >>>>>>>>> time) if no one gets round to it before then. > >>>>>>>>> > >>>>>>>>> -ash > >>>>>>>>> > >>>>>>>>>> On 30 Oct 2017, at 17:58, Chris Riccomini > >>>>>>>>>> > >>>>>>> wrote: > >>>>>>>>>> > >>>>>>>>>> Hey all, > >>>>>>>>>> > >>>>>>>>>> Current blockers for 1.9.0: > >>>>>>>>>> > >>>>>>>>>> https://issues.apache.org/jira/browse/AIRFLOW-1711 > >>>>>>>>>> https://issues.apache.org/jira/browse/AIRFLOW-1018 > >>>>>>>>>> > >>>>>>>>>> Cheers, > >>>>>>>>>> Chris > >>>>>>>>>> > >>>>>>>>>> On Tue, Oct 24, 2017 at 11:06 AM, Chris Riccomini < > >>>>>>> criccomini@apache.org > >>>>>>>>>> > >>>>>>>>>> wrote: > >>>>>>>>>> > >>>>>>>>>>> Hey all, > >>>>>>>>>>> > >>>>>>>>>>> Talked with @Bolke on Gitter. Here are the currently blocking > >>>> issues > >>>>>>> for > >>>>>>>>>>> 1.9.0: > >>>>>>>>>>> > >>>>>>>>>>> AIRFLOW-1744 |Bug ||Blocker ||Open > >>>> |task.retries > >>>>>>> can > >>>>>>>>>>> be False > >>>>>>>>>>> AIRFLOW-1731 |Bug ||Blocker ||Open |Impor= t > >>>>>> custom > >>>>>>>>>>> config on PYTHONPATH > >>>>>>>>>>> AIRFLOW-1641 |Bug ||Blocker ||In Progress|Task > >> gets > >>>>>>> stuck > >>>>>>>>>>> in queued state > >>>>>>>>>>> > >>>>>>>>>>> PRs are out for them. After these three are merged, I'm > >>>>>>>>>>> planning to > >>>>>>> cut > >>>>>>>>> an > >>>>>>>>>>> RC. > >>>>>>>>>>> > >>>>>>>>>>> Cheers, > >>>>>>>>>>> Chris > >>>>>>>>>>> > >>>>>>>>>>> On Fri, Oct 20, 2017 at 7:49 AM, Bolke de Bruin > >>>>>>>>>>> >>>>> > >>>>>>>>> wrote: > >>>>>>>>>>> > >>>>>>>>>>>> I upgraded our production environment today. Some > >>>>>>>>>>>> observations > >>>>>>>>>>>> > >>>>>>>>>>>> 1. Database migration (add max tries) didn=E2=80=99t workout= of the > >>>>>>>>>>>> box > >>>>>>>>> correctly > >>>>>>>>>>>> for Postgres. =E2=80=9Cmax_tries =3D False=E2=80=9D didn=E2= =80=99t work and needed to > >>>>>>>>>>>> be > >>>>>> casted > >>>>>>>>> to an > >>>>>>>>>>>> int. Not sure how this gets to be false. This is a block imh= o > >>>>>>>>>>>> 2. SSHExecuteOperator not having backwards compatibility > >>>>>>>>>>>> sucks. We > >>>>>>>>> needed > >>>>>>>>>>>> to rework quite a lot of dags 3. We use LdAP for logins. We > >>>>>>>>>>>> havent configured the =E2=80=98superuser=E2=80=99 > >>>>>>>>>>>> =E2=80=98data_profiler=E2=80=99 groups and thus should have = automatic > >>>>>>>>>>>> superuser > >>>>>>>>> privileges. > >>>>>>>>>>>> We don=E2=80=99t at the moment (eg. we cannot manage connect= ions or > >>>>>>>>>>>> see > >>>> the > >>>>>>>>> admin > >>>>>>>>>>>> screens). > >>>>>>>>>>>> > >>>>>>>>>>>> After fixing #1, the rest seems quite normal. Happy with the > >>>>>>>>>>>> new > >>>>>>>>> logging. > >>>>>>>>>>>> > >>>>>>>>>>>> Bolke > >>>>>>>>>>>> > >>>>>>>>>>>> > >>>>>>>>>>>>> On 20 Oct 2017, at 12:16, Driesprong, Fokko > >>>>>>>>>>>>> >>>>>>> > >>>>>>>>>>>> wrote: > >>>>>>>>>>>>> > >>>>>>>>>>>>> Hi Bolke, > >>>>>>>>>>>>> > >>>>>>>>>>>>> This one is a blocker: https://issues.apache.org/jira > >>>>>>>>>>>> /browse/AIRFLOW-1731. > >>>>>>>>>>>>> > >>>>>>>>>>>>> This requirers that we are sure that the /plugin/ folder is > >>>>>>>>>>>>> on > >>>> the > >>>>>>>>> path: > >>>>>>>>>>>>> https://github.com/apache/incubator-airflow/blob/eb2f589099= b > >>>>>>>>>>>> 87743482c2eb16261b49e284dcd96/airflow/plugins_manager.py > >>>>>>>>>>>>> > >>>>>>>>>>>>> And maybe add an additional test and updating the docs a bi= t. > >>>>>>>>> Hopefully > >>>>>>>>>>>>> somewhere in the next few days, however I'm a bit busy with > >>>>>>>>>>>>> the > >>>>>>> Spark > >>>>>>>>>>>>> Summit. > >>>>>>>>>>>>> > >>>>>>>>>>>>> Cheers, Fokko > >>>>>>>>>>>>> > >>>>>>>>>>>>> 2017-10-19 21:03 GMT+02:00 Bolke de Bruin >: > >>>>>>>>>>>>> > >>>>>>>>>>>>>> Im planning to upgrade our production to 1.9.0alphaX > tomorrow. > >>>>>>>>>>>>>> > >>>>>>>>>>>>>> What are the issues that are open? > >>>>>>>>>>>>>> > >>>>>>>>>>>>>> Cheers > >>>>>>>>>>>>>> Bolke > >>>>>>>>>>>>>> > >>>>>>>>>>>>>>> On 9 Oct 2017, at 20:24, Chris Riccomini < > >>>> criccomini@apache.org > >>>>>>> > >>>>>>>>>>>> wrote: > >>>>>>>>>>>>>>> > >>>>>>>>>>>>>>> K, I will plan on cutting an alpha1 later this week. > >>>>>>>>>>>>>>> Something > >>>>>> for > >>>>>>>>> you > >>>>>>>>>>>>>> guys to play with. > >>>>>>>>>>>>>>> > >>>>>>>>>>>>>>> On Mon, Oct 9, 2017 at 11:23 AM, Bolke de Bruin < > >>>>>>> bdbruin@gmail.com > >>>>>>>>>>>>>> > wrote: > >>>>>>>>>>>>>>> hi Chris, > >>>>>>>>>>>>>>> > >>>>>>>>>>>>>>> We are still running pre alpha. I am a bit preoccupied > >>>>>>>>>>>>>>> with > >>>>>>>>> preparing > >>>>>>>>>>>>>> for a conference and the team is readying a release of one > >>>>>>>>>>>>>> of > >>>> our > >>>>>>>>> core > >>>>>>>>>>>>>> products. So it will probably will be after this week when > >>>>>>>>>>>>>> I get > >>>>>> my > >>>>>>>>>>>> hands > >>>>>>>>>>>>>> dirty again. > >>>>>>>>>>>>>>> > >>>>>>>>>>>>>>> Cheers > >>>>>>>>>>>>>>> Bolke > >>>>>>>>>>>>>>> > >>>>>>>>>>>>>>> Verstuurd vanaf mijn iPad > >>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> Op 4 okt. 2017 om 23:35 heeft Chris Riccomini < > >>>>>>>>> criccomini@apache.org > >>>>>>>>>>>>>> > het volgende geschreven: > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> Hey all, > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> Checking in. Has anyone tested this in their environment= s? > >>>>>> Stable > >>>>>>>>>>>>>> releases > >>>>>>>>>>>>>>>> depend on community involvement. > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> Cheers, > >>>>>>>>>>>>>>>> Chris > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> On Tue, Oct 3, 2017 at 10:30 PM, Chris Riccomini < > >>>>>>>>>>>>>> criccomini@apache.org > > >>>>>>>>>>>>>>>> wrote: > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>> I've added AIRFLOW-1635 to the v1-9-test branch. It's > >>>>>>>>>>>>>>>>> not in > >>>>>>>>> alpha0, > >>>>>>>>>>>>>> but > >>>>>>>>>>>>>>>>> will be included in alpha1. > >>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>> On Tue, Oct 3, 2017 at 4:13 PM, Feng Lu > >>>>>>>>> >>>>>>>>>>>>> > >>>>>>>>>>>>>> wrote: > >>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>> Hi Chris, > >>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>> I know it's annoying to have last minute commit com in= , > >>>>>>>>>>>>>>>>>> but > >>>>>>> this > >>>>>>>>>>>> is a > >>>>>>>>>>>>>>>>>> highly desirable feature for folks using GCP operators= , > >>>>>>>>>>>>>>>>>> is > >>>> it > >>>>>>>>>>>>>> possible to > >>>>>>>>>>>>>>>>>> include AIRFLOW-1635 > >>>>>>>>>>>>>>>>>> >>>> b3e985a3 > >>>>>> < > >>>>>>>>>>>>>> https://github.com/apache/incubator-airflow/commit/b3e985a= 3 > >>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>> 146272ecfd3ceaaa0d8567e4e9e117d4> > >>>>>>>>>>>>>>>>>> in? > >>>>>>>>>>>>>>>>>> More than happy to offer help if there's something I c= an > >> do. > >>>>>>>>>>>>>>>>>> Thanks a lot. > >>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>> Feng > >>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>> On Mon, Oct 2, 2017 at 3:24 PM, Chris Riccomini < > >>>>>>>>>>>>>> criccomini@apache.org > > >>>>>>>>>>>>>>>>>> wrote: > >>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>> Hey all, > >>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>> I have cut a 1.9.0alpha0 release of Airflow. You can > >>>>>> download > >>>>>>> it > >>>>>>>>>>>>>> here: > >>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>> https://dist.apache.org/repos/dist/dev/incubator/airf= l > >>>>>>>>>>>>>>>>>>> ow/1 > >>>> . > >>>>>>>>>>>>>> 9.0alpha0/ > >>>>>>>>>>>>>> >>>>>>>>>>>>>> airflow/1.9.0alpha0/> > >>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>> The bin tarball can be installed with pip: > >>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>> pip install apache-airflow-1.9.0alpha0+ > >>>>>> incubating-bin.tar.gz > >>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>> The goal is to have the community install and run thi= s > >>>>>>>>>>>>>>>>>>> to > >>>>>>> expose > >>>>>>>>>>>> any > >>>>>>>>>>>>>>>>>> bugs > >>>>>>>>>>>>>>>>>>> before we move on to official release candidates. > >>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>> Here are the outstanding blocker bugs for 1.9.0: > >>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>> AIRFLOW-1525 |Improvement |Fix minor LICENSE & NOTICE > >> issue > >>>>>>>>>>>>>>>>>>> AIRFLOW-1258 |Bug |TaskInstances within > >>>>>> SubDagOperator > >>>>>>>>> are > >>>>>>>>>>>>>>>>>> marked > >>>>>>>>>>>>>>>>>>> as > >>>>>>>>>>>>>>>>>>> AIRFLOW-1055 |Bug |airflow/jobs.py:create_dag= _ > >>>> run() > >>>>>>>>>>>>>> exception > >>>>>>>>>>>>>>>>>>> for > >>>>>>>>>>>>>>>>>>> @on > >>>>>>>>>>>>>>>>>>> AIRFLOW-1018 |Bug |Scheduler DAG processes ca= n > >> not > >>>>>> log > >>>>>>>>> to > >>>>>>>>>>>>>>>>>> stdout > >>>>>>>>>>>>>>>>>>> AIRFLOW-1013 |Bug > |airflow/jobs.py:manage_slas() > >>>>>>>>>>>> exception > >>>>>>>>>>>>>>>>>> for > >>>>>>>>>>>>>>>>>>> @once > >>>>>>>>>>>>>>>>>>> AIRFLOW-976 |Bug |Mark success running task > >> causes > >>>>>> it > >>>>>>>>> to > >>>>>>>>>>>>>> fail > >>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>> Cheers, > >>>>>>>>>>>>>>>>>>> Chris > >>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>> On Fri, Sep 29, 2017 at 3:54 PM, Chris Riccomini < > >>>>>>>>>>>>>> criccomini@apache.org > >>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>> wrote: > >>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>> Welp. Work got in the way, so I'll cut the beta on > >> Monday. > >>>>>> :) > >>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>> On Thu, Sep 28, 2017 at 1:32 PM, Chris Riccomini < > >>>>>>>>>>>>>>>>>> criccomini@apache.org > > >>>>>>>>>>>>>>>>>>>> wrote: > >>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>> Works for me. Will try and cut a beta before end of > >> week. > >>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>> Blockers for 1.9.0 are: > >>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>> AIRFLOW-1611 |Bug |Customize logging in > Airflow > >>>>>>>>>>>>>>>>>>>>> AIRFLOW-1525 |Improvement |Fix minor LICENSE & > >>>>>>>>>>>>>>>>>>>>> NOTICE > >>>>>> issue > >>>>>>>>>>>>>>>>>>>>> AIRFLOW-1258 |Bug |TaskInstances within > >>>>>>> SubDagOperator > >>>>>>>>>>>> are > >>>>>>>>>>>>>>>>>>> marked > >>>>>>>>>>>>>>>>>>>>> as > >>>>>>>>>>>>>>>>>>>>> AIRFLOW-976 |Bug |Mark success running tas= k > >>>>>> causes > >>>>>>> it > >>>>>>>>>>>> to > >>>>>>>>>>>>>>>>>> fail > >>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>> On Thu, Sep 28, 2017 at 1:09 PM, Bolke de Bruin < > >>>>>>>>>>>>>> bdbruin@gmail.com > > >>>>>>>>>>>>>>>>>>>>> wrote: > >>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>> Hi Chris > >>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>> Can I suggest releasing a beta? The stable branch > >>>>>>>>>>>>>>>>>>>>>> is > >>>> only > >>>>>>> cut > >>>>>>>>>>>> at > >>>>>>>>>>>>>> RC > >>>>>>>>>>>>>>>>>>>>>> time. Betas allow us a broader exposure. It also > >>>>>>>>>>>>>>>>>>>>>> gives > >>>>>> us a > >>>>>>>>>>>>>> point of > >>>>>>>>>>>>>>>>>>>>>> reference. > >>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>> In addition the list below are mostly longer > >>>>>>>>>>>>>>>>>>>>>> standing > >>>>>>> issues > >>>>>>>>>>>> that > >>>>>>>>>>>>>>>>>> are > >>>>>>>>>>>>>>>>>>>>>> also part of the 1.8.x branch. Maybe only consider > >>>>>>>>>>>>>>>>>>>>>> 1611, > >>>>>>>>> 1525, > >>>>>>>>>>>>>> 1258, > >>>>>>>>>>>>>>>>>>> and > >>>>>>>>>>>>>>>>>>>>>> 976 as blocker? > >>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>> Cheers > >>>>>>>>>>>>>>>>>>>>>> Bolke > >>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>> Verstuurd vanaf mijn iPad > >>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>> Op 28 sep. 2017 om 19:49 heeft Chris Riccomini < > >>>>>>>>>>>>>>>>>>> criccomini@apache.org > > >>>>>>>>>>>>>>>>>>>>>> het volgende geschreven: > >>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>> Hey all, > >>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>> I was planning to cut a 1.9.0 stable branch and > >>>>>>>>>>>>>>>>>>>>>>> 1.9.0 > >>>>>> beta > >>>>>>>>>>>>>>>>>> release, > >>>>>>>>>>>>>>>>>>> but > >>>>>>>>>>>>>>>>>>>>>>> seeing as there are several outstanding bugs, I'm > >>>>>>>>>>>>>>>>>>>>>>> going > >>>>>> to > >>>>>>>>>>>>>> delay. > >>>>>>>>>>>>>>>>>>> Here > >>>>>>>>>>>>>>>>>>>>>> are > >>>>>>>>>>>>>>>>>>>>>>> the bugs that I'm tracking: > >>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1611 |Bug |Customize logging in > >> Airflow > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1525 |Improvement |Fix minor LICENSE & > >>>>>>>>>>>>>>>>>>>>>>> NOTICE > >>>>>>> issue > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1258 |Bug |TaskInstances within > >>>>>>>>> SubDagOperator > >>>>>>>>>>>>>> are > >>>>>>>>>>>>>>>>>>>>>> marked as > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1055 |Bug > >> |airflow/jobs.py:create_dag_ > >>>>>>> run() > >>>>>>>>>>>>>>>>>>> exception > >>>>>>>>>>>>>>>>>>>>>> for > >>>>>>>>>>>>>>>>>>>>>>> @on > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1018 |Bug |Scheduler DAG processe= s > >> can > >>>>>> not > >>>>>>>>> log > >>>>>>>>>>>>>> to > >>>>>>>>>>>>>>>>>>>>>> stdout > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1013 |Bug > >>>> |airflow/jobs.py:manage_slas() > >>>>>>>>>>>>>>>>>> exception > >>>>>>>>>>>>>>>>>>>>>> for @once > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-988 |Bug |SLA Miss Callbacks Are > >>>>>> Repeated > >>>>>>>>> if > >>>>>>>>>>>>>>>>>> Email > >>>>>>>>>>>>>>>>>>> is > >>>>>>>>>>>>>>>>>>>>>> Not > >>>>>>>>>>>>>>>>>>>>>>> be > >>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-976 |Bug |Mark success running > task > >>>>>>> causes > >>>>>>>>> it > >>>>>>>>>>>>>> to > >>>>>>>>>>>>>>>>>>> fail > >>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>> These are the priority issues. Once they're > >>>>>>>>>>>>>>>>>>>>>>> merged, > >>>> I'll > >>>>>>> cut > >>>>>>>>>>>> the > >>>>>>>>>>>>>>>>>>>>>>> v1-9-stable and beta release. > >>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>> If you can help clean this up, that would be > >>>>>>>>>>>>>>>>>>>>>>> really > >>>>>>>>>>>> appreciated. > >>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>> Cheers, > >>>>>>>>>>>>>>>>>>>>>>> Chris > >>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>> On Thu, Sep 28, 2017 at 10:06 AM, Chris Riccomini > >>>>>>>>>>>>>>>>>>>>>>> < > >>>>>>>>>>>>>>>>>>>>>> criccomini@apache.org > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>> wrote: > >>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>> Marked it for 1.9.0. > >>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>> On Thu, Sep 28, 2017 at 9:56 AM, Charlie Jones = < > >>>>>>>>>>>>>>>>>> cjones@simpli.fi > > >>>>>>>>>>>>>>>>>>>>>> wrote: > >>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>> Is there any chance we could include AIRFLOW-98= 8 > >>>>>>>>>>>>>>>>>>>>>>>>> in > >>>>>>> 1.9.0? > >>>>>>>>>>>> SLA > >>>>>>>>>>>>>>>>>>>>>> callbacks > >>>>>>>>>>>>>>>>>>>>>>>>> are not working correctly without emails... Its > >>>>>>>>>>>>>>>>>>>>>>>>> not a > >>>>>>>>> major > >>>>>>>>>>>>>> bug, > >>>>>>>>>>>>>>>>>>> but > >>>>>>>>>>>>>>>>>>>>>> it > >>>>>>>>>>>>>>>>>>>>>>>>> does cause us some annoyance in our current > >>>>>> deployment. > >>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>> Link to Jira: > >>>>>>>>>>>>>>>>>>>>>>>>> https://issues.apache.org/jira/browse/AIRFLOW-9= 8 > >>>>>>>>>>>>>>>>>>>>>>>>> 8 < > >>>>>>>>>>>>>> https://issues.apache.org/jira/browse/AIRFLOW-988> > >>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>> Link to PR: > >>>>>>>>>>>>>>>>>>>>>>>>> https://github.com/apache/ > >>>> incubator-airflow/pull/2415 > >>>>>> < > >>>>>>>>>>>>>> https://github.com/apache/incubator-airflow/pull/2415> > >>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>> Thanks! > >>>>>>>>>>>>>>>>>>>>>>>>> Charlie Jones > >>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>> CHARLIE JONES > >>>>>>>>>>>>>>>>>>>>>>>>> Data Engineer > >>>>>>>>>>>>>>>>>>>>>>>>> cjones@simpli.fi | > M: > >>>>>>>>>>>>>> 972.821.7631 > >>>>>>>>>>>>>>>>>>>>>>>>> _______________________________________________= _ > >>>>>>>>>>>>>>>>>>>>>>>>> __ > >>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>> Programmatic Performance.* Localized.* > >>>>>>>>>>>>>>>>>>>>>>>>> _______________________________________________= _ > >>>>>>>>>>>>>>>>>>>>>>>>> __ > >>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>> 1407 Texas Street | Suite 202 | Fort Worth, > >>>>>>>>>>>>>>>>>>>>>>>>> TX > >>>>>> 76102 > >>>>>>>>>>>>>>>>>>>>>>>>> 800.840.0768 | > >>>>>>>>>>>>>>>>>>>>>>>>> www.simpli.fi < > >>>>>>>>>>>>>> http://www.simpli.fi/> > >>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>> On Wed, Sep 27, 2017 at 12:11 PM, Chris > >>>>>>>>>>>>>>>>>>>>>>>>> Riccomini < > >>>>>>>>>>>>>>>>>>>>>> criccomini@apache.org > >>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>> wrote: > >>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>> Merged. > >>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>> On Tue, Sep 26, 2017 at 2:25 PM, Ryan Buckley = < > >>>>>>>>>>>>>>>>>>>>>>>>> ryan.buckley@bluecore.com >>>>>> ryan.buckley@bluecore > >>>>>>> . > >>>>>>>>> com > >>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>> wrote: > >>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>> Would it be possible to include AIRFLOW-1587? > >>>>>>>>>>>>>>>>>>>>>>>>>>> Running dags from the UI is currently broken > >>>>>>>>>>>>>>>>>>>>>>>>>>> on the > >>>>>>>>> 1.9.0 > >>>>>>>>>>>>>>>>>> branch > >>>>>>>>>>>>>>>>>>>>>> due > >>>>>>>>>>>>>>>>>>>>>>>>> to > >>>>>>>>>>>>>>>>>>>>>>>>>>> this issue. > >>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>> https://github.com/apache/ > >>>>>> incubator-airflow/pull/2590 > >>>>>>> < > >>>>>>>>>>>>>> https://github.com/apache/incubator-airflow/pull/2590> > >>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks, > >>>>>>>>>>>>>>>>>>>>>>>>>>> Ryan > >>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>> On Tue, Sep 26, 2017 at 8:14 AM, Driesprong, > >>>>>>>>>>>>>>>>>>>>>>>>>>> Fokko > >>>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>> wrote: > >>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>> Hi All, > >>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>> I would like to include AIRFLOW-1611 in the > >>>>>>>>>>>>>>>>>>>>>>>>>>>> 1.9.0 > >>>>>>>>>>>> release: > >>>>>>>>>>>>>>>>>>>>>>>>>>>> https://github.com/apache/ > >>>>>>> incubator-airflow/pull/2631 > >>>>>>>>> < > >>>>>>>>>>>>>> https://github.com/apache/incubator-airflow/pull/2631> > >>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>> Currently importing a custom logging > >>>>>>>>>>>>>>>>>>>>>>>>>>>> configuration > >>>>>> is > >>>>>>>>> not > >>>>>>>>>>>>>>>>>> work > >>>>>>>>>>>>>>>>>>> (as > >>>>>>>>>>>>>>>>>>>>>>>>> far > >>>>>>>>>>>>>>>>>>>>>>>>>>> as I > >>>>>>>>>>>>>>>>>>>>>>>>>>>> know). Any feedback on the PR would also be > >>>>>>>>> appreciated. > >>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>> Cheers, Fokko > >>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>> 2017-09-25 23:27 GMT+02:00 Chris Riccomini < > >>>>>>>>>>>>>>>>>>> criccomini@apache.org > >>>>>>>>>>>>>>>>>>>>>>> : > >>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> Done! > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Mon, Sep 25, 2017 at 5:11 AM, Michael > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> Crawford > >>>>>> < > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> michael.crawford@modernizingmedicine.com > >>>> >>>>>>>>>>>>>> michael.crawford@modernizingmedicine.com>> wrote: > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Can you slide the aws and emr connection > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> type > >>>> fix > >>>>>>> in? > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> https://issues.apache.org/ > >>>>>> jira/browse/AIRFLOW-1636 > >>>>>>> < > >>>>>>>>>>>>>> https://issues.apache.org/jira/browse/AIRFLOW-1636> < > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> https://issues.apache.org/ > >>>>>> jira/browse/AIRFLOW-1636 > >>>>>>> < > >>>>>>>>>>>>>> https://issues.apache.org/jira/browse/AIRFLOW-1636>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> https://github.com/apache/ > >>>>>>>>> incubator-airflow/pull/2626 > >>>>>>>>>>>> < > >>>>>>>>>>>>>> https://github.com/apache/incubator-airflow/pull/2626> < > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> https://github.com/apache/ > >>>>>>>>> incubator-airflow/pull/2626 > >>>>>>>>>>>> < > >>>>>>>>>>>>>> https://github.com/apache/incubator-airflow/pull/2626>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> It keeps the connection type from getting > >>>> blanked > >>>>>>> out > >>>>>>>>>>>> on > >>>>>>>>>>>>>>>>>> edit > >>>>>>>>>>>>>>>>>>>>>>>>> for > >>>>>>>>>>>>>>>>>>>>>>>>>>> these > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> types. > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks, > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Mike > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Sep 21, 2017, at 1:27 PM, Chris > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Riccomini < > >>>>>>>>>>>>>>>>>>>>>>>>>>> criccomini@apache.org >>>> criccomini@apache.org > >>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> wrote: > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Absolutely. Just cherry-picked. I've been > >>>>>> looking > >>>>>>>>>>>>>> forward > >>>>>>>>>>>>>>>>>> to > >>>>>>>>>>>>>>>>>>>>>>>>>> these > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> fixes! > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Wed, Sep 20, 2017 at 5:23 PM, Alex > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Guziel < > >>>>>>>>>>>>>>>>>>>>>>>>>>> alex.guziel@airbnb.com >>>>>> alex.guziel@airbnb.com > >>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>> . > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> invalid > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> wrote: > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Can we get this in? > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> https://issues.apache.org/ > >>>>>>> jira/browse/AIRFLOW-1519 > >>>>>>>>> < > >>>>>>>>>>>>>> https://issues.apache.org/jira/browse/AIRFLOW-1519> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> https://issues.apache.org/ > >>>>>>> jira/browse/AIRFLOW-1621 > >>>>>>>>> < > >>>>>>>>>>>>>> https://issues.apache.org/jira/browse/AIRFLOW-1621> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> https://github.com/apache/ > >>>>>>>>> incubator-airflow/commit/ > >>>>>>>>>>>> < > >>>>>>>>>>>>>> https://github.com/apache/incubator-airflow/commit/> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> b6d2e0a46978e93e16576604624f57d1388814f2 > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> https://github.com/apache/ > >>>>>>>>> incubator-airflow/commit/ > >>>>>>>>>>>> < > >>>>>>>>>>>>>> https://github.com/apache/incubator-airflow/commit/> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 656d045e90bf67ca484a3778b2a07a419bfb324a > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> It speeds up loading times a lot, so it'= s > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> a > >>>>>> good > >>>>>>>>>>>> thing > >>>>>>>>>>>>>> to > >>>>>>>>>>>>>>>>>>>>>>>>> have > >>>>>>>>>>>>>>>>>>>>>>>>>> in > >>>>>>>>>>>>>>>>>>>>>>>>>>>> 1.9. > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Wed, Sep 20, 2017 at 11:14 AM, Chris > >>>>>>> Riccomini < > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> criccomini@apache.org >>>>>>> criccomini@apache.org> > >>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> wrote: > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Sounds good. I'll plan on stable+beta > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> next > >>>>>> week, > >>>>>>>>>>>> then. > >>>>>>>>>>>>>>>>>>>>>>>>> Initial > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> warning > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> stands, that I will start locking down > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> what > >>>>>> can > >>>>>>>>> get > >>>>>>>>>>>>>> into > >>>>>>>>>>>>>>>>>>>>>>>>> 1.9.0 > >>>>>>>>>>>>>>>>>>>>>>>>>> at > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> that > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> point. > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Wed, Sep 20, 2017 at 11:10 AM, Bolke > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> de > >>>>>>> Bruin < > >>>>>>>>>>>>>>>>>>>>>>>>>>>> bdbruin@gmail.com = > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> wrote: > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> No vote indeed, just to gather feedbac= k > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> on a > >>>>>>>>>>>>>> particular > >>>>>>>>>>>>>>>>>>>>>>>>> fixed > >>>>>>>>>>>>>>>>>>>>>>>>>>>> point > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> in > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> time. It also gives a bit more trust t= o > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> a > >>>>>>> tarball > >>>>>>>>>>>>>> than > >>>>>>>>>>>>>>>>>> to > >>>>>>>>>>>>>>>>>>> a > >>>>>>>>>>>>>>>>>>>>>>>>>> git > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> pull. > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Bolke > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On 20 Sep 2017, at 20:09, Chris > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Riccomini > >>>> < > >>>>>>>>>>>>>>>>>>>>>>>>>>> criccomini@apache.org >>>> criccomini@apache.org > >>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> wrote: > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> I can do a beta. Is the process > >>>>>> significantly > >>>>>>>>>>>>>>>>>> different? > >>>>>>>>>>>>>>>>>>>>>>>>>> IIRC, > >>>>>>>>>>>>>>>>>>>>>>>>>>>> it's > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> basically the same, just no vote, > right? > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Wed, Sep 20, 2017 at 10:56 AM, > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Bolke de > >>>>>>>>> Bruin < > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> bdbruin@gmail.com > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> > > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> wrote: > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Are you sure you want to go ahead an= d > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> do > >>>>>> RCs > >>>>>>>>>>>> right > >>>>>>>>>>>>>>>>>> away? > >>>>>>>>>>>>>>>>>>>>>>>>>>> Isn=E2=80=99t a > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> beta > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> a > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> bit smarter? > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> - Bolke > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On 20 Sep 2017, at 19:41, Chris > >>>> Riccomini > >>>>>> < > >>>>>>>>>>>>>>>>>>>>>>>>>>>> criccomini@apache.org >>>>>> criccomini@apache.org> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> wrote: > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Hey all, > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> I want to send out a warning that > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> I'm > >>>>>>> planning > >>>>>>>>>>>> to > >>>>>>>>>>>>>>>>>> cut > >>>>>>>>>>>>>>>>>>>>>>>>> the > >>>>>>>>>>>>>>>>>>>>>>>>>>>> stable > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> branch > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> next week, and begin the RC1 releas= e > >>>> vote. > >>>>>>>>> Once > >>>>>>>>>>>>>> the > >>>>>>>>>>>>>>>>>>>>>>>>> stable > >>>>>>>>>>>>>>>>>>>>>>>>>>>> branch > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> is > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> cut, I > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> will be locking down what commits > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> get > >>>>>> cherry > >>>>>>>>>>>>>> picked > >>>>>>>>>>>>>>>>>>> into > >>>>>>>>>>>>>>>>>>>>>>>>>> the > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> branch, > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> and > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> will only be doing PRs that are > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> required > >>>>>> to > >>>>>>>>> get > >>>>>>>>>>>>>> the > >>>>>>>>>>>>>>>>>>>>>>>>> release > >>>>>>>>>>>>>>>>>>>>>>>>>>>> out. > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Cheers, Chris > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Mon, Sep 18, 2017 at 11:19 AM, > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Chris > >>>>>>>>>>>> Riccomini > >>>>>>>>>>>>>> < > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> criccomini@apache.org >>>>>>>>>>>> criccomini@apache.org> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> wrote: > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Hey all, > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> An update on the 1.9.0 release. > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Here > >>>> are > >>>>>>> the > >>>>>>>>>>>>>>>>>>>>>>>>> outstanding > >>>>>>>>>>>>>>>>>>>>>>>>>> PRs > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> that > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> are > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> slated to be included into 1.9.0: > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> ISSUE ID |STATUS > |DESCRIPTION > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1617 |Open |XSS > >>>>>>> Vulnerability in > >>>>>>>>>>>>>>>>>> Variable > >>>>>>>>>>>>>>>>>>>>>>>>>>>> endpoint > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1611 |Open |Customize > >>>>>>> logging in > >>>>>>>>>>>>>>>>>> Airflow > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1605 |Reopened |Fix log > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> source > >>>>>> of > >>>>>>>>>>>> local > >>>>>>>>>>>>>>>>>>>>>>>>> loggers > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1604 |Open |Rename th= e > >>>>>>> logger to > >>>>>>>>>>>> log > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1525 |Open |Fix minor > >>>>>>> LICENSE & > >>>>>>>>>>>>>> NOTICE > >>>>>>>>>>>>>>>>>>>>>>>>> issue > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1499 |In Progres|Eliminate > >>>>>>> duplicate > >>>>>>>>>>>> and > >>>>>>>>>>>>>>>>>>>>>>>>> unneeded > >>>>>>>>>>>>>>>>>>>>>>>>>>> code > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1198 |Open > |HDFSOperator > >>>> to > >>>>>>>>>>>> operate > >>>>>>>>>>>>>>>>>> HDFS > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1055 |Open > >>>>>>>>>>>>>>>>>> |airflow/jobs.py:create_dag_ru > >>>>>>>>>>>>>>>>>>>>>>>>> n() > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> exception > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> for > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> @on > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1019 |Open > >> |active_dagruns > >>>>>>>>>>>> shouldn't > >>>>>>>>>>>>>>>>>>>>>>>>> include > >>>>>>>>>>>>>>>>>>>>>>>>>>>> paused > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> DAGs > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1018 |Open |Scheduler > >> DAG > >>>>>>>>>>>> processes > >>>>>>>>>>>>>>>>>> can > >>>>>>>>>>>>>>>>>>>>>>>>> not > >>>>>>>>>>>>>>>>>>>>>>>>>> log > >>>>>>>>>>>>>>>>>>>>>>>>>>>> to > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> stdout > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1015 |Open |TreeView > >>>>>>> displayed > >>>>>>>>>>>> over > >>>>>>>>>>>>>>>>>> task > >>>>>>>>>>>>>>>>>>>>>>>>>>>> instances > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-1013 |Open > >>>>>>>>>>>>>>>>>> |airflow/jobs.py:manage_slas() > >>>>>>>>>>>>>>>>>>>>>>>>>>>> exception > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> for > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> @once > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-976 |Open |Mark > success > >>>>>>> running > >>>>>>>>>>>>>> task > >>>>>>>>>>>>>>>>>>>>>>>>> causes > >>>>>>>>>>>>>>>>>>>>>>>>>> it > >>>>>>>>>>>>>>>>>>>>>>>>>>>> to > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> fail > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-914 |Open |Refactor > >>>>>>>>>>>>>>>>>>>>>>>>>>>> BackfillJobTest.test_backfill_ > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> examples > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> to > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-913 |Open |Refactor > >>>>>>>>>>>>>>>>>>>>>>>>>>>> tests.CoreTest.test_scheduler_ > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> job > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> to > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> real > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-912 |Open |Refactor > >> tests > >>>>>>> and > >>>>>>>>>>>> build > >>>>>>>>>>>>>>>>>>>>>>>>> matrix > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-888 |Open |Operators > >>>>>> should > >>>>>>> not > >>>>>>>>>>>>>> push > >>>>>>>>>>>>>>>>>>>>>>>>> XComs > >>>>>>>>>>>>>>>>>>>>>>>>>> by > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> default > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-828 |Open |Add > maximum > >>>>>> size > >>>>>>> for > >>>>>>>>>>>>>> XComs > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-825 |Open |Add > Dataflow > >>>>>>>>> semantics > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> AIRFLOW-788 |Open |Context > >>>>>>> unexpectedly > >>>>>>>>>>>>>>>>>> added to > >>>>>>>>>>>>>>>>>>>>>>>>>> hive > >>>>>>>>>>>>>>>>>>>>>>>>>>>> conf > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> I will be locking down what can ge= t > >>>>>>>>>>>> cherry-picked > >>>>>>>>>>>>>>>>>> into > >>>>>>>>>>>>>>>>>>>>>>>>> the > >>>>>>>>>>>>>>>>>>>>>>>>>>>> 1.9.0 > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> branch > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> shortly, so if you have something > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> you > >>>>>> want > >>>>>>>>> in, > >>>>>>>>>>>>>>>>>> please > >>>>>>>>>>>>>>>>>>>>>>>>> set > >>>>>>>>>>>>>>>>>>>>>>>>>>> the > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> fix > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> version > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> to 1.9.0. > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> We (at WePay) have deployed 1.9.0 > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> into > >>>>>> our > >>>>>>>>> dev > >>>>>>>>>>>>>>>>>>> cluster, > >>>>>>>>>>>>>>>>>>>>>>>>>> and > >>>>>>>>>>>>>>>>>>>>>>>>>>> it > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> has > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> been > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> running smoothly for several days. > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> ** I could really use help > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> verifying > >>>>>>>>> stability. > >>>>>>>>>>>>>> If > >>>>>>>>>>>>>>>>>> you > >>>>>>>>>>>>>>>>>>>>>>>>> run > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Airflow, > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> it's > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> in your best interest to deploy th= e > >>>>>> 1.9.0 > >>>>>>>>> test > >>>>>>>>>>>>>>>>>> branch > >>>>>>>>>>>>>>>>>>>>>>>>>>>> somewhere, > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> and > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> verify > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> it's working for your workload. ** > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Cheers, Chris > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>> > >>>>>>>>>>>>>> > >>>>>>>>>>>>>> > >>>>>>>>>>>> > >>>>>>>>>>>> > >>>>>>>>>>> > >>>>>>>>> > >>>>>>>>> > >>>>>>> > >>>>>>> > >>>>>> > >>>> > >>>> > >> > >> > >> -------------------------------------------------------------------- > >> > >> Intel Technology Poland sp. z o.o. > >> ul. Slowackiego 173 | 80-298 Gdansk | Sad Rejonowy Gdansk Polnoc | VII > >> Wydzial Gospodarczy Krajowego Rejestru Sadowego - KRS 101882 | NIP > >> 957-07-52-316 | Kapital zakladowy 200.000 PLN. > >> > >> Ta wiadomosc wraz z zalacznikami jest przeznaczona dla okreslonego > >> adresata i moze zawierac informacje poufne. W razie przypadkowego > >> otrzymania tej wiadomosci, prosimy o powiadomienie nadawcy oraz trwale > jej > >> usuniecie; jakiekolwiek > >> przegladanie lub rozpowszechnianie jest zabronione. > >> This e-mail and any attachments may contain confidential material for > the > >> sole use of the intended recipient(s). If you are not the intended > >> recipient, please contact the sender and delete all copies; any review > or > >> distribution by > >> others is strictly prohibited. > >> > > --001a1141bd6a43cef6055d1b37b0--