incubator-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Siddharth Anand <>
Subject Re: [PROPOSAL] : Airflow
Date Mon, 21 Mar 2016 21:23:51 GMT
Hi Stian,
Thanks for the feedback. We are committed to moving towards Apache
community-friendly licensing as documented on

I've added this to our Roadmap: and I expect to tackle it
during the incubation phase.

Regarding our Google group - yes. We will move to the mailing list.  We currently have *258
members*, with about 10 new members being added daily! If you have any
thoughts on how to make that transition more amenable to our community,
they are welcome. For one, the google group offers more functionality than
the old-style mailing lists. I don't mind moving. I would like to keep the
old group's messages searchable and provide an announcement feature to
point people to the Apache mailing list so they know where to go next if
they land on the Google group. Some threads will unfortunately be
decapitated, but we can provide a few months' time for our users to
transition to the Apache mailing lists, wrapping up topic threads or
copying them over.  We will also need to stop accepting new members and
posts in the existing group, but I think that is pretty simple to do.

Thanks for the heads up on CWL and Taverna. We will definitely look into
both. On our side, our user base is growing faster than we can keep up.
Hence, we are investing in growing the committer base and documentation,
and in leveraging processes in order to better meet the growing needs of
our community. We hope to reduce turn-around time on PR reviews/merges,
time between releases, bringing new developers on board, and converting
contributors to committers.


On Mon, Mar 21, 2016 at 4:23 PM, Stian Soiland-Reyes <>

> Airflow sounds like an interesting workflow project!
> You will need to review the licenses of dependencies - some of them
> are not compatible with ASF policy [1], e.g.
> is LGPL, which is not permitted.
> (I didn't check all of them)
> You may be able to work around this particular one if you are using
> Python's DB API 2.0 and don't have an explicit dependency on psycopg2
> (e.g. so a downstream user can reasonably use Airflow without
> psycopg2)
> (Note: you can solve this as part of incubation process - but say if
> your project strongly used 15 GPL and LGPL dependencies, then your
> project might want to reconsider if it would be worth the effort)
> I recognize the challenge of engaging extension developers to also
> care about the 'core'. Moving to an "Apache Way" open development will
> probably help for this, as all dev discussions are in the open. Is
> your plan to move the existing Airflow Google Groups to what will be
> the mailing list?
> Have you been talking to the SciDap folks doing Common Workflow
> Language [3] support with Airflow? That could be one angle to look at
> increasing the user base. We're also working on Docker and CWL support
> in Apache Taverna [4] - so I'm interested in seeing what we could have
> in common!
> [1]
> [2]
> [3]
> [4]
> On 17 March 2016 at 00:28, Siddharth Anand <>
> wrote:
> >
> >
> > Thoughts and comments are welcome!
> > -s (Sid)
> --
> Stian Soiland-Reyes
> Apache Taverna (incubating), Apache Commons RDF (incubating)
> ---------------------------------------------------------------------
> To unsubscribe, e-mail:
> For additional commands, e-mail:

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message