Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 2D389200D2F for ; Wed, 1 Nov 2017 19:10:14 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 2BB56160BEA; Wed, 1 Nov 2017 18:10:14 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 70D6F1609EC for ; Wed, 1 Nov 2017 19:10:13 +0100 (CET) Received: (qmail 51966 invoked by uid 500); 1 Nov 2017 18:10:12 -0000 Mailing-List: contact dev-help@airflow.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@airflow.incubator.apache.org Delivered-To: mailing list dev@airflow.incubator.apache.org Received: (qmail 51954 invoked by uid 99); 1 Nov 2017 18:10:12 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Nov 2017 18:10:12 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 44E8E1A0B20 for ; Wed, 1 Nov 2017 18:10:11 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.379 X-Spam-Level: X-Spam-Status: No, score=0.379 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=modernizingmedicine.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id xvzamyJ9r7oz for ; Wed, 1 Nov 2017 18:10:10 +0000 (UTC) Received: from mail-ua0-f178.google.com (mail-ua0-f178.google.com [209.85.217.178]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 4936A5F566 for ; Wed, 1 Nov 2017 18:10:10 +0000 (UTC) Received: by mail-ua0-f178.google.com with SMTP id l40so2156678uah.2 for ; Wed, 01 Nov 2017 11:10:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=modernizingmedicine.com; s=modernizingmedicine; h=from:content-transfer-encoding:mime-version:subject:message-id:date :to; bh=MuUOJK4j0U29EZo/3vojNs2ayLQueoCWeSYk0SSV3CI=; b=B6Ldbbka21+PyaP+BzRISSlAp0B7nuWhKjjIM8G9Rec7DGkgLBlqIfvAxd7JdKrg2H nWw2lyz9fqaTFASXXIE3tZ+jN+6x8DTrvS0GM2E17f+eulwyiMqM/lYmxOeUISJilhqi /bXuuBpDNclGiC/I7mcOxNZEEY1j65gKPn2TY= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:message-id:date:to; bh=MuUOJK4j0U29EZo/3vojNs2ayLQueoCWeSYk0SSV3CI=; b=cLceiTjc4WYJUzMwkp74snBjmcbwQ6mp31X4bImLrposrCl+Jqh66IjGccUsosJC9B DTw5pRwxJ/baCvht6bOIoeadZ/X6AzLywNhhVwOUdvKNil5pUFbMdzmV7gUJsVLTO/PX fPu6WuHA2YpqnL79/ogwL5nsSjNHo2BZyyCaihJbXO8XgasENWmeq2ofwris1tz9asHf 0aD4YMFfPJr6C9NdQyh8cFpaq28hvoglQ9QjIrQEElW/0n/fE5ZN6/8ivnKOyOm4JTJG FRZ4G7Jci78d4pfLpM9dnl7WOze4eG8GM5Pqpgpl1I/fhhRjgmfSeb5QX2GYk+WwPUiN FyKg== X-Gm-Message-State: AMCzsaWfg6ntevBcxmjgvxI7R7jyDvsbh+bQWOm/KyVIZhUZ4iUET5Si c/VaEEJvBZgMtKGyehkzN9OlW0/wbC1Bxth1oePJ8CzHcoIjcyDk1QVut7B71iVdJdRulZRYOsZ g+wwRu1OpxELWZy4dPsFvLqHg9CBftsI5mTscMx24w1ZAP+WF8rcbgtddrwy6bpr+VoCJb3Vp/E iBe9toP5taUzw0Yz2V6t3DE/xmPpGvZI0= X-Google-Smtp-Source: ABhQp+RLnIsNC6zG+SQynFhWs4IjcNYk1QHxCMz92e1pgsU2xE64Cn14/OwuyI6LK6dMCkfBqY0HBQ== X-Received: by 10.176.68.226 with SMTP id n89mr585496uan.178.1509559804227; Wed, 01 Nov 2017 11:10:04 -0700 (PDT) Received: from [10.129.2.149] ([45.73.148.210]) by smtp.gmail.com with ESMTPSA id k32sm821161uaf.11.2017.11.01.11.10.03 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 01 Nov 2017 11:10:03 -0700 (PDT) From: Michael Crawford Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Multiple similar DAGs Message-Id: Date: Wed, 1 Nov 2017 14:10:02 -0400 To: dev@airflow.incubator.apache.org X-Mailer: Apple Mail (2.3273) archived-at: Wed, 01 Nov 2017 18:10:14 -0000 Hi All, Is there a best practice regarding registering similar DAGs which only = differ in small variables. For instance say I have an certain ETL that I want to run on several = different environments on different schedules. All of the DAGs would essentially be the exactly the same just with a = few different parameters. It doesn=E2=80=99t seem like duplicating the DAG code over and over is = the right way to do this. Thanks, Mike=