arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wes McKinney (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (ARROW-350) Add Kerberos support to HDFS shim
Date Sat, 29 Oct 2016 01:14:58 GMT

     [ https://issues.apache.org/jira/browse/ARROW-350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Wes McKinney resolved ARROW-350.
--------------------------------
    Resolution: Fixed

Issue resolved by pull request 185
[https://github.com/apache/arrow/pull/185]

> Add Kerberos support to HDFS shim
> ---------------------------------
>
>                 Key: ARROW-350
>                 URL: https://issues.apache.org/jira/browse/ARROW-350
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: C++, Python
>            Reporter: Christopher Aycock
>            Assignee: Christopher Aycock
>
> Speaking with [~wesmckinn], it would be really helpful to have Kerberos support in our
HDFS logic. This should be straightforward; I would just need to switch to {{hdfsBuilderConnect()}}
in the shim.
> On a side note, is there a reason we aren't using Pivotal's libhdfs3? It uses RPCs natively
rather than JNI.
> https://github.com/Pivotal-Data-Attic/pivotalrd-libhdfs3
> Dask has Python wrappers for this.
> https://github.com/dask/hdfs3



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message