Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 6075B2009FB for ; Fri, 6 May 2016 14:09:19 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 5EF36160A0C; Fri, 6 May 2016 12:09:19 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id A80991609F6 for ; Fri, 6 May 2016 14:09:18 +0200 (CEST) Received: (qmail 38067 invoked by uid 500); 6 May 2016 12:09:17 -0000 Mailing-List: contact commits-help@airflow.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@airflow.incubator.apache.org Delivered-To: mailing list commits@airflow.incubator.apache.org Received: (qmail 38058 invoked by uid 99); 6 May 2016 12:09:17 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 May 2016 12:09:17 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 473D31A05A3 for ; Fri, 6 May 2016 12:09:17 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -4.021 X-Spam-Level: X-Spam-Status: No, score=-4.021 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id YHGIsuuvwXyy for ; Fri, 6 May 2016 12:09:15 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with SMTP id F010E5F23F for ; Fri, 6 May 2016 12:09:13 +0000 (UTC) Received: (qmail 37811 invoked by uid 99); 6 May 2016 12:09:13 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 May 2016 12:09:13 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id D19122C14F9 for ; Fri, 6 May 2016 12:09:12 +0000 (UTC) Date: Fri, 6 May 2016 12:09:12 +0000 (UTC) From: "Bolke de Bruin (JIRA)" To: commits@airflow.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (AIRFLOW-52) Release airflow 1.7.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Fri, 06 May 2016 12:09:19 -0000 [ https://issues.apache.org/jira/browse/AIRFLOW-52?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin updated AIRFLOW-52: ---------------------------------- Description: Release the airflow 1.7.1 tag. Current status: There are three issues blocking this release caused by this commit: https://github.com/apache/incubator-airflow/commit/fb0c5775cda4f84c07d8d5c0e6277fc387c172e6 1. DAGs with a lot of tasks take much longer to parse (~25x slowdown) 2. The following kind of patterns fail: {code} email.set_upstream(dag.roots) dag.add_task(email) {code} This is because set_upstream now calls add_task and a task can't be added more than once. I'm working with the owner of the commit to resolve these issues. The way to catch (1) in the future is an integration test that asserts a given non-trivial DAG parses under X seconds. 3. Airflow loosing queued tasks (see linked issue) was: Release the airflow 1.7.1 tag. Current status: There are two issues blocking this release caused by this commit: https://github.com/apache/incubator-airflow/commit/fb0c5775cda4f84c07d8d5c0e6277fc387c172e6 1. DAGs with a lot of tasks take much longer to parse (~25x slowdown) 2. The following kind of patterns fail: {code} email.set_upstream(dag.roots) dag.add_task(email) {code} This is because set_upstream now calls add_task and a task can't be added more than once. I'm working with the owner of the commit to resolve these issues. The way to catch (1) in the future is an integration test that asserts a given non-trivial DAG parses under X seconds. > Release airflow 1.7.1 > --------------------- > > Key: AIRFLOW-52 > URL: https://issues.apache.org/jira/browse/AIRFLOW-52 > Project: Apache Airflow > Issue Type: Task > Components: ease > Reporter: Dan Davydov > Assignee: Dan Davydov > Labels: release > > Release the airflow 1.7.1 tag. > Current status: > There are three issues blocking this release caused by this commit: > https://github.com/apache/incubator-airflow/commit/fb0c5775cda4f84c07d8d5c0e6277fc387c172e6 > 1. DAGs with a lot of tasks take much longer to parse (~25x slowdown) > 2. The following kind of patterns fail: > {code} > email.set_upstream(dag.roots) > dag.add_task(email) > {code} > This is because set_upstream now calls add_task and a task can't be added more than once. > I'm working with the owner of the commit to resolve these issues. > The way to catch (1) in the future is an integration test that asserts a given non-trivial DAG parses under X seconds. > 3. Airflow loosing queued tasks (see linked issue) -- This message was sent by Atlassian JIRA (v6.3.4#6332)