airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Driesprong, Fokko" <fo...@driesprong.frl>
Subject Re: Airflow 1.10.5 Python 2.7 compatability
Date Mon, 16 Sep 2019 22:24:31 GMT
Thanks for the heads up Jarek, great to hear that it already has been
patched.

Cheers, Fokko

Op di 17 sep. 2019 om 00:22 schreef Jarek Potiuk <Jarek.Potiuk@polidea.com>:

> Fokko - It's marshmallow-sqlalchemy - it's been fixed in master and
> v1-10-test branch in https://issues.apache.org/jira/browse/AIRFLOW-5430 (to
> be released in 1.10.6). It was a problem for both 3.5 and 2.7.
> Hopefully with some ways to dependency-pin release versions.
>
> Maxime - 3.5 is still officially supported by Airflow. The previous LTS
> Debian shipped with 3.5 so we decided to stay with 3.5 as a base (though I
> would also welcome 3.6 and f-strings especially).
> The new Debian (buster) comes with 3.7. And indeed 3.7 is picking up
> significantly. 3.6 is the  most popular. We still have quite significant
> amount of downloads from 3.5 so I think just removing it is not a good idea:
>
>
> https://photos.google.com/share/AF1QipPHqi5M1GT9K5k0Y-bPAC6o7SV4sx79pEjo2cc_Mfp5atmu33kiv_JJjM5npnOu6A?key=RV9BYzRvTFFuSGd2Uld0NkNpTzEtaWhEemN5T3hR
>
> J.
>
> On Mon, Sep 16, 2019 at 11:55 PM Maxime Beauchemin <
> maximebeauchemin@gmail.com> wrote:
>
>> Fokko, surprised to see you use 3.5 . I thought most people went straight
>> to 3.6 as soon as it came out, as there are very little reasons to be on
>> the 3 to 3.5 range anymore
>>
>> I'd say we should go straight to 3.6+ for Airflow as we deprecate 2.7
>> https://pythonclock.org/
>>
>> On Mon, Sep 16, 2019 at 2:17 PM Driesprong, Fokko <fokko@driesprong.frl>
>> wrote:
>>
>> > Hi guys,
>> >
>> > While preparing a training, I think we have another incompatible
>> dependency
>> > that screws up Python 2.7 compatibility:
>> >
>> > MacBook-Pro-van-Fokko:airspark fokkodriesprong$ kubectl logs
>> > airflow-deployment-f55b986f-5tmt7 webserver
>> >
>> > [2019-09-16 21:10:40,045] {settings.py:213} INFO -
>> > settings.configure_orm(): Using pool settings. pool_size=5,
>> > max_overflow=10, pool_recycle=1800, pid=6
>> >
>> > /usr/local/lib/python3.5/dist-packages/psycopg2/__init__.py:144:
>> > UserWarning: The psycopg2 wheel package will be renamed from release
>> 2.8;
>> > in order to keep installing from binary please use "pip install
>> > psycopg2-binary" instead. For details see: <
>> > http://initd.org/psycopg/docs/install.html#binary-install-from-pypi>.
>> >
>> >   """)
>> >
>> > [2019-09-16 21:10:41,188] {__init__.py:51} INFO - Using executor
>> > KubernetesExecutor
>> >
>> > Traceback (most recent call last):
>> >
>> >   File "/usr/local/bin/airflow", line 22, in <module>
>> >
>> >     from airflow.bin.cli import CLIFactory
>> >
>> >   File "/usr/local/lib/python3.5/dist-packages/airflow/bin/cli.py", line
>> > 68, in <module>
>> >
>> >     from airflow.www_rbac.app import cached_app as cached_app_rbac
>> >
>> >   File "/usr/local/lib/python3.5/dist-packages/airflow/www_rbac/app.py",
>> > line 26, in <module>
>> >
>> >     from flask_appbuilder import AppBuilder, SQLA
>> >
>> >   File
>> > "/usr/local/lib/python3.5/dist-packages/flask_appbuilder/__init__.py",
>> line
>> > 5, in <module>
>> >
>> >     from .base import AppBuilder
>> >
>> >   File
>> "/usr/local/lib/python3.5/dist-packages/flask_appbuilder/base.py",
>> > line 5, in <module>
>> >
>> >     from .api.manager import OpenApiManager
>> >
>> >   File
>> >
>> "/usr/local/lib/python3.5/dist-packages/flask_appbuilder/api/__init__.py",
>> > line 11, in <module>
>> >
>> >     from marshmallow_sqlalchemy.fields import Related, RelatedList
>> >
>> >   File
>> >
>> >
>> "/usr/local/lib/python3.5/dist-packages/marshmallow_sqlalchemy/__init__.py",
>> > line 1, in <module>
>> >
>> >     from .schema import TableSchemaOpts, ModelSchemaOpts, TableSchema,
>> > ModelSchema
>> >
>> >   File
>> >
>> "/usr/local/lib/python3.5/dist-packages/marshmallow_sqlalchemy/schema.py",
>> > line 3, in <module>
>> >
>> >     from .convert import ModelConverter
>> >
>> >   File
>> >
>> "/usr/local/lib/python3.5/dist-packages/marshmallow_sqlalchemy/convert.py",
>> > line 80
>> >
>> >     ):
>> >
>> >
>> >
>> > It looks like it is coming from the flask_appbuilder. I'll look into
>> more
>> > details somewhere tomorrow, and provide a PR. Did more people run into
>> > this?
>> >
>> > Cheers, Fokko
>> >
>>
>
>
> --
>
> Jarek Potiuk
> Polidea <https://www.polidea.com/> | Principal Software Engineer
>
> M: +48 660 796 129 <+48660796129>
> [image: Polidea] <https://www.polidea.com/>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message