airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Maxime Beauchemin <maximebeauche...@gmail.com>
Subject Re: Dynamic creation of DAG
Date Tue, 22 Nov 2016 21:46:03 GMT
I added a paragraph to the FAQ entry: "How can I create DAGs dynamically?"

The GH link above points straight to that paragraph. It's related to an
issue that was discussed on this mailing list last week.

I agree that working examples are ideal, and they can help with test
coverage as well.

Max

On Tue, Nov 22, 2016 at 1:10 PM, siddharth anand <sanand@apache.org> wrote:

> Hi Max,
> Which part in the above PR is related to dynamic dags?
>
> When thinking about adding documentation about functionality, I propose the
> community bias towards adding working examples and test coverage. We offer
> a quick start (which by the way needs some updates - for example, why does
> it not start airflow-scheduler after starting the webserver?), but then
> folks get stuck in how to write DAGs and use the full range of Airflow
> capabilities. This is where examples and better test coverage help keep
> newbies productive.
>
> Perhaps the examples and tests can be upgraded to show a fuller set of
> dynamic dag capabilities?
>
> -s
>
> On Mon, Nov 21, 2016 at 7:55 PM, Maxime Beauchemin <
> maximebeauchemin@gmail.com> wrote:
>
> > I just added a bit of information about dynamic DAG creation here:
> > https://github.com/apache/incubator-airflow/pull/1889/files#diff-
> > c6f0a0722c6a2f86277535d7bcec7f8cR162
> >
> > Let me know if it helps.
> >
> > Max
> >
> > On Mon, Nov 21, 2016 at 2:58 AM, Deepak Kumar Malladi <
> > kapeed2091@gmail.com>
> > wrote:
> >
> > > Hi,
> > >
> > > I want to dynamically create DAG during run time. I tried the snippet
> > given
> > > in the documentation. But it didnt work for me.
> > >
> > > Any pointer on how to trigger DAGs which aren't actually present in DAG
> > > folder but are created through code execution (dynamically created)?
> > >
> > >
> > > Thanks & Regards,
> > > Deepak
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message