Mailing-List: contact dev-help@airflow.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@airflow.incubator.apache.org
MIME-Version: 1.0
From: Marc Weil <mweil@newrelic.com>
Date: Fri, 8 Dec 2017 14:46:14 -0800
Message-ID: <CAMxvOetDuOV7y6x-L4jGnHCa3+L2Z+FqZMBBK+f03NTb0tQTyQ@mail.gmail.com>
Subject: Cleared tasks don't activate DAG Runs
To: dev@airflow.incubator.apache.org
Content-Type: multipart/alternative; boundary="f403045dc07c9f0e6c055fdbf412"
archived-at: Fri, 08 Dec 2017 22:46:35 -0000

--f403045dc07c9f0e6c055fdbf412
Content-Type: text/plain; charset="UTF-8"

Hi everyone,

I'm trying to bulk clear a single task through all of history for one of
our DAG runs so only that task re-runs. Usually, when I clear a small
number of tasks, this will automatically activate all the DAG runs as well
and the cleared tasks run just fine. However, when I clear this task going
back for the entire history of the DAG (about 360 DAG runs in this
particular case), most (but not all) of the DAG runs remain in "completed"
state. When I try to manually mark them all as Running via the DAG Runs UI,
they all flip back over to Success immediately even though there are
uncompleted tasks within all of them.

Has anyone ever seen this behavior before? Any tips on how to force Airflow
to pick up all these cleared tasks to rerun them? This is on Airflow 1.8.0.

Thanks!

--
Marc Weil | Lead Engineer | Growth Data (GAME) | New Relic

--f403045dc07c9f0e6c055fdbf412--