airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bolke de Bruin (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (AIRFLOW-840) Python3 encoding issue in Kerberos
Date Tue, 14 Mar 2017 20:52:41 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Bolke de Bruin reassigned AIRFLOW-840:
--------------------------------------

    Assignee: Bolke de Bruin

> Python3 encoding issue in Kerberos
> ----------------------------------
>
>                 Key: AIRFLOW-840
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-840
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: security
>    Affects Versions: Airflow 1.8
>         Environment: $ python --version
> Python 3.4.3
>            Reporter: Erik Cederstrand
>            Assignee: Bolke de Bruin
>              Labels: security
>
> While attempting to configure Kerberos ticket renewal in a Python3 environment, I encountered
this encoding issue trying to run {{airflow kerberos}}:
> {code:none}
> Traceback (most recent call last):
>   File "/usr/local/bin/airflow", line 15, in <module>
>     args.func(args)
>   File "/usr/local/lib/python3.4/dist-packages/airflow/bin/cli.py", line 600, in kerberos
>     airflow.security.kerberos.run()
>   File "/usr/local/lib/python3.4/dist-packages/airflow/security/kerberos.py", line 110,
in run
>     renew_from_kt()
>   File "/usr/local/lib/python3.4/dist-packages/airflow/security/kerberos.py", line 55,
in renew_from_kt
>     "\n".join(subp.stderr.readlines())))
> TypeError: sequence item 0: expected str instance, bytes found
> {code}
> The issue here (ignoring for a moment why {{kinit}} is failing on my machine) is that
Popen in Python3 returns {{bytes}} for stdin/stdout, but both are handled as if they are {{str}}.
> I'm unsure what the Py2/3 compat policy is at Airflow, but a simple {{from six import
PY2}} and an if/else seems like the least intrusive fix. The non-PY2 path would then add something
like {{subp.stdin.readlines().decode(errors='ignore')}}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message