From dev-return-5639-archive-asf-public=cust-asf.ponee.io@airflow.incubator.apache.org Mon Jul 23 02:17:56 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id CD0ED18062F for ; Mon, 23 Jul 2018 02:17:55 +0200 (CEST) Received: (qmail 7547 invoked by uid 500); 23 Jul 2018 00:17:54 -0000 Mailing-List: contact dev-help@airflow.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@airflow.incubator.apache.org Delivered-To: mailing list dev@airflow.incubator.apache.org Received: (qmail 7536 invoked by uid 99); 23 Jul 2018 00:17:54 -0000 Received: from ui-eu-01.ponee.io (HELO localhost) (176.9.59.70) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 23 Jul 2018 00:17:54 +0000 From: srinivas.ramabhadran@gmail.com To: Date: Mon, 23 Jul 2018 00:17:52 -0000 Subject: Simple DAG Structure References: Message-ID: MIME-Version: 1.0 x-ponymail-sender: d6b720aeb9db1b3be543eed6ea013c0a9a94f80a x-ponymail-agent: PonyMail Composer/0.3 Content-Type: text/plain; charset=utf-8 In-Reply-To: X-Mailer: LuaSocket 3.0-rc1 Hi - I have recently started using Airflow version 1.9.0 and am having some difficulty setting up a very simple DAG. I have three tasks A, B and C. I'd like A to run every day at 10am and B at 11am. C depends on BOTH A and B running successfully. Initially, I decided to create one DAG, add all three tasks to it and set C as downstream to A and B. I then set the schedule_interval of the DAG to @daily. But this meant I couldn't run A and B at 10am and 11am respectively since the they are PythonOperators and tasks dont support schedule_interval (or, at least, it's deprecated syntax and gets ignored). I scratched that idea and then created A and B as DAGs, specified the schedule interval as per the cron syntax: '00 10 * * *' for A and '00 11 * * *' for B. But now when I set C as a downstream of A and B, it complains that C can't belong to two different dags. How do I accomplish such a simple dependency structure? Ram.