arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wes McKinney (JIRA)" <j...@apache.org>
Subject [jira] [Created] (ARROW-473) [C++/Python] Add public API for retrieving block locations for a particular HDFS file
Date Tue, 10 Jan 2017 20:01:00 GMT
Wes McKinney created ARROW-473:
----------------------------------

             Summary: [C++/Python] Add public API for retrieving block locations for a particular
HDFS file
                 Key: ARROW-473
                 URL: https://issues.apache.org/jira/browse/ARROW-473
             Project: Apache Arrow
          Issue Type: New Feature
          Components: C++, Python
            Reporter: Wes McKinney


This is necessary for applications looking to schedule data-local work. libhdfs does not have
APIs to request the block locations directly, so we need to see if the {{hdfsGetHosts}} function
will do what we need. For libhdfs3 there is a public API function 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message