arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Christopher Aycock (JIRA)" <>
Subject [jira] [Created] (ARROW-350) Add Kerberos support to HDFS shim
Date Thu, 27 Oct 2016 14:50:58 GMT
Christopher Aycock created ARROW-350:

             Summary: Add Kerberos support to HDFS shim
                 Key: ARROW-350
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++, Python
            Reporter: Christopher Aycock
            Assignee: Christopher Aycock

Speaking with [~wesmckinn], it would be really helpful to have Kerberos support in our HDFS
logic. This should be straightforward; I would just need to switch to {{hdfsBuilderConnect()}}
in the shim.

On a side note, is there a reason we aren't using Pivotal's libhdfs3? It uses RPCs natively
rather than JNI.

Dask has Python wrappers for this.

This message was sent by Atlassian JIRA

View raw message