Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 22B4A2009FB for ; Fri, 6 May 2016 18:28:18 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 214A2160A0D; Fri, 6 May 2016 16:28:18 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 729211608F8 for ; Fri, 6 May 2016 18:28:17 +0200 (CEST) Received: (qmail 43042 invoked by uid 500); 6 May 2016 16:28:16 -0000 Mailing-List: contact commits-help@airflow.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@airflow.incubator.apache.org Delivered-To: mailing list commits@airflow.incubator.apache.org Received: (qmail 43033 invoked by uid 99); 6 May 2016 16:28:16 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 May 2016 16:28:16 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 2ACC2C00E6 for ; Fri, 6 May 2016 16:28:16 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -4.021 X-Spam-Level: X-Spam-Status: No, score=-4.021 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id yinzGUvDSRCw for ; Fri, 6 May 2016 16:28:14 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with SMTP id AF29E5F295 for ; Fri, 6 May 2016 16:28:13 +0000 (UTC) Received: (qmail 42940 invoked by uid 99); 6 May 2016 16:28:13 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 May 2016 16:28:13 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 03BE32C1F62 for ; Fri, 6 May 2016 16:28:13 +0000 (UTC) Date: Fri, 6 May 2016 16:28:13 +0000 (UTC) From: "Jeremiah Lowin (JIRA)" To: commits@airflow.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (AIRFLOW-52) Release airflow 1.7.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Fri, 06 May 2016 16:28:18 -0000 [ https://issues.apache.org/jira/browse/AIRFLOW-52?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremiah Lowin updated AIRFLOW-52: ---------------------------------- Description: Release the airflow 1.7.1 tag. Current status: There are three issues blocking this release caused by this commit: https://github.com/apache/incubator-airflow/commit/fb0c5775cda4f84c07d8d5c0e6277fc387c172e6 1. DAGs with a lot of tasks take much longer to parse (~25x slowdown) 2. The following kind of patterns fail: {code} email.set_upstream(dag.roots) dag.add_task(email) {code} This is because set_upstream now calls add_task and a task can't be added more than once. I'm working with the owner of the commit to resolve these issues. The way to catch (1) in the future is an integration test that asserts a given non-trivial DAG parses under X seconds. 3. Airflow losing queued tasks (see linked issue) was: Release the airflow 1.7.1 tag. Current status: There are three issues blocking this release caused by this commit: https://github.com/apache/incubator-airflow/commit/fb0c5775cda4f84c07d8d5c0e6277fc387c172e6 1. DAGs with a lot of tasks take much longer to parse (~25x slowdown) 2. The following kind of patterns fail: {code} email.set_upstream(dag.roots) dag.add_task(email) {code} This is because set_upstream now calls add_task and a task can't be added more than once. I'm working with the owner of the commit to resolve these issues. The way to catch (1) in the future is an integration test that asserts a given non-trivial DAG parses under X seconds. 3. Airflow loosing queued tasks (see linked issue) > Release airflow 1.7.1 > --------------------- > > Key: AIRFLOW-52 > URL: https://issues.apache.org/jira/browse/AIRFLOW-52 > Project: Apache Airflow > Issue Type: Task > Components: ease > Reporter: Dan Davydov > Assignee: Dan Davydov > Labels: release > > Release the airflow 1.7.1 tag. > Current status: > There are three issues blocking this release caused by this commit: > https://github.com/apache/incubator-airflow/commit/fb0c5775cda4f84c07d8d5c0e6277fc387c172e6 > 1. DAGs with a lot of tasks take much longer to parse (~25x slowdown) > 2. The following kind of patterns fail: > {code} > email.set_upstream(dag.roots) > dag.add_task(email) > {code} > This is because set_upstream now calls add_task and a task can't be added more than once. > I'm working with the owner of the commit to resolve these issues. > The way to catch (1) in the future is an integration test that asserts a given non-trivial DAG parses under X seconds. > 3. Airflow losing queued tasks (see linked issue) -- This message was sent by Atlassian JIRA (v6.3.4#6332)