airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Maxime Beauchemin <maximebeauche...@gmail.com>
Subject Re: airflow 1.8.0 documentation ?
Date Wed, 08 Mar 2017 22:16:41 GMT
Thanks for taking that on. It's mostly an effort in mocking all the libs
that cannot be built in the readthedocs environment. This may require a
specific `requirements.txt`->`readthedocs-reqs.txt` for that purpose with
only the core dependencies needed to parse the modules.

Max

On Wed, Mar 8, 2017 at 1:40 PM, Daniel Huang <dxhuang@gmail.com> wrote:

> Just filed https://issues.apache.org/jira/browse/AIRFLOW-956 to setup
> readthedocs. I'll give it a shot.
>
> On Wed, Mar 8, 2017 at 12:29 PM, Jake Gysland <jgysland@optoro.com> wrote:
>
> > I'm glad there's new documentation available for 1.8.0, but replacing the
> > documentation for the latest stable release with the documentation for a
> > future release candidate can lead to experiences that are ...
> frustrating,
> > as I've discovered this afternoon while trying to help a colleague QA a
> DAG
> > and finding documentation for CLI flags that don't exist.
> >
> > Can we at least get a version number (or... a commit hash?) into the
> > documentation somewhere that's reasonably visible?
> >
> > On Mon, Mar 6, 2017 at 12:20 PM, Maxime Beauchemin <
> > maximebeauchemin@gmail.com> wrote:
> >
> > > I just pushed a new version of the docs out.
> > >
> > > We may want to set up a service like https://readthedocs.org/ to offer
> > > versioned docs. It would require setting up some "mocking" of external
> > libs
> > > that can't be installed on the RTD build nodes and that actually
> > shouldn't
> > > be required to build the docs. From my understanding the mocking of
> libs
> > > would have to be done here in this file:
> > > https://github.com/airbnb/superset/blob/master/docs/conf.py
> > >
> > > It would be great if someone wanted to take that on.
> > >
> > > Max
> > >
> > > On Mon, Mar 6, 2017 at 8:46 AM, Michael Gong <gonwg@hotmail.com>
> wrote:
> > >
> > > > Hi,
> > > >
> > > >
> > > > Does anyone know where I can find the documentation for the coming
> > > airflow
> > > > 1.8.0 release ?
> > > >
> > > >
> > > > thanks.
> > > >
> > > > Michael
> > > >
> > > >
> > > > ________________________________
> > > > From: Michael Gong <gonwg@hotmail.com>
> > > > Sent: Monday, March 6, 2017 2:37 PM
> > > > To: dev; Michael Gong
> > > > Subject: Re: Airflow running different with different user id ?
> > > >
> > > > Hi, Dan,
> > > >
> > > > The only doc mentioning "run_as" was in the airflow.operators.
> > > > HiveOperator.
> > > >
> > > > Is this what you mean "run_as"?
> > > >
> > > > If not, can you provide more information about it? We are very
> > interested
> > > > to know more .
> > > >
> > > > Thanks.
> > > > Michael
> > > >
> > > > Sent from my PP•KING™ smartphone
> > > >
> > > > On Mar 3, 2017 3:57 PM, Michael Gong <gonwg@hotmail.com> wrote:
> > > > Hi, Dan,
> > > >
> > > >
> > > > Thanks for the encouraging news.
> > > >
> > > >
> > > > Maybe you could direct me to the documentation about "run_as" so I
> > could
> > > > see whether it is for my purpose.
> > > >
> > > >
> > > > I guess it will be passed as an argument for the DAG object , right ?
> > > >
> > > >
> > > > Thanks again.
> > > >
> > > >
> > > > Michael
> > > >
> > > >
> > > >
> > > >
> > > > ________________________________
> > > > From: Dan Davydov <dan.davydov@airbnb.com.INVALID>
> > > > Sent: Friday, March 3, 2017 8:44 PM
> > > > To: dev@airflow.incubator.apache.org
> > > > Subject: Re: Airflow running different with different user id ?
> > > >
> > > > Within a couple of weeks.
> > > >
> > > > On Fri, Mar 3, 2017 at 12:34 PM, Michael Gong <gonwg@hotmail.com>
> > wrote:
> > > >
> > > > > When approximately will it be released?
> > > > >
> > > > > Sent from my PP•KING™ smartphone
> > > > >
> > > > > On Mar 3, 2017 1:42 PM, Dan Davydov <dan.davydov@airbnb.com.
> INVALID>
> > > > > wrote:
> > > > > Yes it is starting on 1.8.0 which will be released soon, you can
> look
> > > in
> > > > > the documentation/grep for "run_as".
> > > > >
> > > > > On Mar 3, 2017 8:50 AM, "Michael Gong" <gonwg@hotmail.com>
wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > >
> > > > > > Suppose I have 1 airflow instance running 2 different DAGs,
is it
> > > > > possible
> > > > > > to specify the 2 DAGs running under 2 different ids ?
> > > > > >
> > > > > >
> > > > > > Any advises are welcomed.
> > > > > >
> > > > > >
> > > > > > Thanks.
> > > > > >
> > > > > > Michael
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> >
> >
> > --
> >
> > Jake Gysland
> >
> > Data Pipeline Engineer
> >
> > www.optoro.com
> >
> > [image: Optoro, Inc.] <http://www.optoro.com/>
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message