Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id C4D4F200BD3 for ; Tue, 22 Nov 2016 04:56:01 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id C3998160B19; Tue, 22 Nov 2016 03:56:01 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 18895160AF9 for ; Tue, 22 Nov 2016 04:56:00 +0100 (CET) Received: (qmail 13836 invoked by uid 500); 22 Nov 2016 03:56:00 -0000 Mailing-List: contact dev-help@airflow.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@airflow.incubator.apache.org Delivered-To: mailing list dev@airflow.incubator.apache.org Received: (qmail 13818 invoked by uid 99); 22 Nov 2016 03:55:59 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Nov 2016 03:55:59 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 4D3ABC0D8D for ; Tue, 22 Nov 2016 03:55:59 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.399 X-Spam-Level: ** X-Spam-Status: No, score=2.399 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id LMwOSCk1kcqI for ; Tue, 22 Nov 2016 03:55:57 +0000 (UTC) Received: from mail-io0-f179.google.com (mail-io0-f179.google.com [209.85.223.179]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 3ACF95FC4A for ; Tue, 22 Nov 2016 03:55:57 +0000 (UTC) Received: by mail-io0-f179.google.com with SMTP id x94so58097333ioi.3 for ; Mon, 21 Nov 2016 19:55:57 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=DsVyHOld0MCm3VddpQfNY3a1MDhMWEcPWeC8KEFCNME=; b=x8744cFg3evkELRZpHxoSUsd+2FpF+nlUmJJeFaiQnUFko3Wdal5hOcU5hx+j0jS5g NBqugmACA9XEWI6k3kz1/FyWdeOuV7cxguVaKNghHjfuz/9MD0POAZqxH510JJd8yDv3 wfUPGXi/duJC9xlJJD4+lpGmlWjHQAZFbgQvmAkbcduhqHMYaNkPaGKYfTEkFvvGXYur dEUggnVvfrcCfGWsY3g2DF5H8nYHy93Fqw0KzFzVSslyaMDmJ6cllES6yc9EtK6GQ5r2 0wo49lVpRnGX9aKeafIwVBcpYEGuMvV17p93fQBPtQXespH74kwQg5dmJPUO5/rdPAVh Xodg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=DsVyHOld0MCm3VddpQfNY3a1MDhMWEcPWeC8KEFCNME=; b=XiuQsoW8iMw7h6wII9VdG55O2/xUHmhR12pHcJ5wiCYsk4pmNih4Ge4TfS6eIAO+pE vh2XQke4RiipAq2+IBDfuAOloWrJ/LnHdrcHCkxyq6D10aKg2gniXM3JgnRAzFsa2YAr s2ONIp5jtJd0m6zhnyzUyenZhSvMcL/2NQ/ay1M+Dgd1U6+RsDfihgCcMJQnQ/qdmO5U Zab2lGsqoSkNjORDeHq11wxYKfKRpXxxlGpuwVa3Qvc8T5GOc+cMKDu9CUyP6ON3AZ3Q 9N31JxgcWeNE6RRQC1Pd6F1g4QtBesTSKlS1sXzgv8unTw5+zWA3AgTKg4WqPuA1TqSR O5lA== X-Gm-Message-State: AKaTC017SU5yLB65GT5H1xivBtTsMGxEl3/Qt/r1TV9ebO74Efju+qij0qXfcHRYV0zXJNsOp/t6AlMsrlCbAQ== X-Received: by 10.107.149.13 with SMTP id x13mr11212726iod.57.1479786950847; Mon, 21 Nov 2016 19:55:50 -0800 (PST) MIME-Version: 1.0 Received: by 10.79.162.134 with HTTP; Mon, 21 Nov 2016 19:55:50 -0800 (PST) In-Reply-To: References: From: Maxime Beauchemin Date: Mon, 21 Nov 2016 19:55:50 -0800 Message-ID: Subject: Re: Dynamic creation of DAG To: dev@airflow.incubator.apache.org Content-Type: multipart/alternative; boundary=001a1140fd508c74330541dbbfea archived-at: Tue, 22 Nov 2016 03:56:02 -0000 --001a1140fd508c74330541dbbfea Content-Type: text/plain; charset=UTF-8 I just added a bit of information about dynamic DAG creation here: https://github.com/apache/incubator-airflow/pull/1889/files#diff-c6f0a0722c6a2f86277535d7bcec7f8cR162 Let me know if it helps. Max On Mon, Nov 21, 2016 at 2:58 AM, Deepak Kumar Malladi wrote: > Hi, > > I want to dynamically create DAG during run time. I tried the snippet given > in the documentation. But it didnt work for me. > > Any pointer on how to trigger DAGs which aren't actually present in DAG > folder but are created through code execution (dynamically created)? > > > Thanks & Regards, > Deepak > --001a1140fd508c74330541dbbfea--