From commits-return-13367-archive-asf-public=cust-asf.ponee.io@airflow.incubator.apache.org Thu Mar 22 07:55:08 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id E94BA18067E for ; Thu, 22 Mar 2018 07:55:07 +0100 (CET) Received: (qmail 45645 invoked by uid 500); 22 Mar 2018 06:55:06 -0000 Mailing-List: contact commits-help@airflow.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@airflow.incubator.apache.org Delivered-To: mailing list commits@airflow.incubator.apache.org Received: (qmail 45635 invoked by uid 99); 22 Mar 2018 06:55:06 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 22 Mar 2018 06:55:06 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 47D8D1802EA for ; Thu, 22 Mar 2018 06:55:06 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -110.311 X-Spam-Level: X-Spam-Status: No, score=-110.311 tagged_above=-999 required=6.31 tests=[ENV_AND_HDR_SPF_MATCH=-0.5, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01, USER_IN_DEF_SPF_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 5sdO4iAZyz1N for ; Thu, 22 Mar 2018 06:55:02 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 646C25FD91 for ; Thu, 22 Mar 2018 06:55:02 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 805FBE0D84 for ; Thu, 22 Mar 2018 06:55:01 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 8D5C7214DD for ; Thu, 22 Mar 2018 06:55:00 +0000 (UTC) Date: Thu, 22 Mar 2018 06:55:00 +0000 (UTC) From: "ASF subversion and git services (JIRA)" To: commits@airflow.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (AIRFLOW-1460) Tasks get stuck in the "removed" state MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/AIRFLOW-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409139#comment-16409139 ] ASF subversion and git services commented on AIRFLOW-1460: ---------------------------------------------------------- Commit 8c42d03c4e35a0046e46f0e2e6db588702ee7e8b in incubator-airflow's branch refs/heads/master from [~tronbabylove] [ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=8c42d03 ] [AIRFLOW-1460] Allow restoration of REMOVED TI's When a task instance exists in the database but its corresponding task no longer exists in the DAG, the scheduler marks the task instance as REMOVED. Once removed, task instances stayed removed forever, even if the task were to be added back to the DAG. This change allows for the restoration of REMOVED task instances. If a task instance is in state REMOVED but the corresponding task is present in the DAG, restore the task instance by setting its state to NONE. A new unit test simulates the removal and restoration of a task from a DAG and verifies that the task instance is restored: `./run_unit_tests.sh tests.models:DagRunTest` JIRA: https://issues.apache.org/jira/browse/AIRFLOW-1460 Closes #3137 from astahlman/airflow-1460-restore- tis > Tasks get stuck in the "removed" state > -------------------------------------- > > Key: AIRFLOW-1460 > URL: https://issues.apache.org/jira/browse/AIRFLOW-1460 > Project: Apache Airflow > Issue Type: Bug > Reporter: George Leslie-Waksman > Assignee: George Leslie-Waksman > Priority: Major > Fix For: 1.9.1 > > > The current handling of task instances that get assigned the state "removed" is that they get ignored. > If the underlying task later gets re-added, the existing task instances will prevent the task from running in the future. -- This message was sent by Atlassian JIRA (v7.6.3#76005)