airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Maxime Beauchemin <maximebeauche...@gmail.com>
Subject Re: airflow 1.8.0 documentation ?
Date Fri, 10 Mar 2017 17:50:44 GMT
Thanks to Daniel and Arthur, we now have a few versions of the docs up on
ReadTheDocs.
https://readthedocs.org/projects/airflow/

I updated the wiki with the links. Let me know if you think we need to
publish older versions of the docs.

Max

On Wed, Mar 8, 2017 at 2:16 PM, Maxime Beauchemin <
maximebeauchemin@gmail.com> wrote:

> Thanks for taking that on. It's mostly an effort in mocking all the libs
> that cannot be built in the readthedocs environment. This may require a
> specific `requirements.txt`->`readthedocs-reqs.txt` for that purpose with
> only the core dependencies needed to parse the modules.
>
> Max
>
> On Wed, Mar 8, 2017 at 1:40 PM, Daniel Huang <dxhuang@gmail.com> wrote:
>
>> Just filed https://issues.apache.org/jira/browse/AIRFLOW-956 to setup
>> readthedocs. I'll give it a shot.
>>
>> On Wed, Mar 8, 2017 at 12:29 PM, Jake Gysland <jgysland@optoro.com>
>> wrote:
>>
>> > I'm glad there's new documentation available for 1.8.0, but replacing
>> the
>> > documentation for the latest stable release with the documentation for a
>> > future release candidate can lead to experiences that are ...
>> frustrating,
>> > as I've discovered this afternoon while trying to help a colleague QA a
>> DAG
>> > and finding documentation for CLI flags that don't exist.
>> >
>> > Can we at least get a version number (or... a commit hash?) into the
>> > documentation somewhere that's reasonably visible?
>> >
>> > On Mon, Mar 6, 2017 at 12:20 PM, Maxime Beauchemin <
>> > maximebeauchemin@gmail.com> wrote:
>> >
>> > > I just pushed a new version of the docs out.
>> > >
>> > > We may want to set up a service like https://readthedocs.org/ to
>> offer
>> > > versioned docs. It would require setting up some "mocking" of external
>> > libs
>> > > that can't be installed on the RTD build nodes and that actually
>> > shouldn't
>> > > be required to build the docs. From my understanding the mocking of
>> libs
>> > > would have to be done here in this file:
>> > > https://github.com/airbnb/superset/blob/master/docs/conf.py
>> > >
>> > > It would be great if someone wanted to take that on.
>> > >
>> > > Max
>> > >
>> > > On Mon, Mar 6, 2017 at 8:46 AM, Michael Gong <gonwg@hotmail.com>
>> wrote:
>> > >
>> > > > Hi,
>> > > >
>> > > >
>> > > > Does anyone know where I can find the documentation for the coming
>> > > airflow
>> > > > 1.8.0 release ?
>> > > >
>> > > >
>> > > > thanks.
>> > > >
>> > > > Michael
>> > > >
>> > > >
>> > > > ________________________________
>> > > > From: Michael Gong <gonwg@hotmail.com>
>> > > > Sent: Monday, March 6, 2017 2:37 PM
>> > > > To: dev; Michael Gong
>> > > > Subject: Re: Airflow running different with different user id ?
>> > > >
>> > > > Hi, Dan,
>> > > >
>> > > > The only doc mentioning "run_as" was in the airflow.operators.
>> > > > HiveOperator.
>> > > >
>> > > > Is this what you mean "run_as"?
>> > > >
>> > > > If not, can you provide more information about it? We are very
>> > interested
>> > > > to know more .
>> > > >
>> > > > Thanks.
>> > > > Michael
>> > > >
>> > > > Sent from my PP•KING™ smartphone
>> > > >
>> > > > On Mar 3, 2017 3:57 PM, Michael Gong <gonwg@hotmail.com> wrote:
>> > > > Hi, Dan,
>> > > >
>> > > >
>> > > > Thanks for the encouraging news.
>> > > >
>> > > >
>> > > > Maybe you could direct me to the documentation about "run_as" so I
>> > could
>> > > > see whether it is for my purpose.
>> > > >
>> > > >
>> > > > I guess it will be passed as an argument for the DAG object , right
>> ?
>> > > >
>> > > >
>> > > > Thanks again.
>> > > >
>> > > >
>> > > > Michael
>> > > >
>> > > >
>> > > >
>> > > >
>> > > > ________________________________
>> > > > From: Dan Davydov <dan.davydov@airbnb.com.INVALID>
>> > > > Sent: Friday, March 3, 2017 8:44 PM
>> > > > To: dev@airflow.incubator.apache.org
>> > > > Subject: Re: Airflow running different with different user id ?
>> > > >
>> > > > Within a couple of weeks.
>> > > >
>> > > > On Fri, Mar 3, 2017 at 12:34 PM, Michael Gong <gonwg@hotmail.com>
>> > wrote:
>> > > >
>> > > > > When approximately will it be released?
>> > > > >
>> > > > > Sent from my PP•KING™ smartphone
>> > > > >
>> > > > > On Mar 3, 2017 1:42 PM, Dan Davydov <dan.davydov@airbnb.com
>> .INVALID>
>> > > > > wrote:
>> > > > > Yes it is starting on 1.8.0 which will be released soon, you
can
>> look
>> > > in
>> > > > > the documentation/grep for "run_as".
>> > > > >
>> > > > > On Mar 3, 2017 8:50 AM, "Michael Gong" <gonwg@hotmail.com>
wrote:
>> > > > >
>> > > > > > Hi,
>> > > > > >
>> > > > > >
>> > > > > > Suppose I have 1 airflow instance running 2 different DAGs,
is
>> it
>> > > > > possible
>> > > > > > to specify the 2 DAGs running under 2 different ids ?
>> > > > > >
>> > > > > >
>> > > > > > Any advises are welcomed.
>> > > > > >
>> > > > > >
>> > > > > > Thanks.
>> > > > > >
>> > > > > > Michael
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> >
>> >
>> > --
>> >
>> > Jake Gysland
>> >
>> > Data Pipeline Engineer
>> >
>> > www.optoro.com
>> >
>> > [image: Optoro, Inc.] <http://www.optoro.com/>
>> >
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message