airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (AIRFLOW-2697) Drop snakebite in favour of hdfs3
Date Sun, 02 Sep 2018 18:09:02 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-2697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Apache Spark reassigned AIRFLOW-2697:
-------------------------------------

    Assignee: Holden Karau's magical unicorn  (was: Julian de Ruiter)

> Drop snakebite in favour of hdfs3
> ---------------------------------
>
>                 Key: AIRFLOW-2697
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2697
>             Project: Apache Airflow
>          Issue Type: Improvement
>    Affects Versions: 1.9.0
>            Reporter: Julian de Ruiter
>            Assignee: Holden Karau's magical unicorn
>            Priority: Major
>
> The current HdfsHook relies on the snakebite library, which is unfortunately not compatible
with Python 3. To add Python 3 support for the HdfsHook requires switching to a different
library for interacting with HDFS. The hdfs3 library is an attractive alternative, as it supports
Python 3 and seems to be stable and relatively well supported.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message