hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Demai Ni (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client
Date Fri, 20 Feb 2015 00:28:12 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14328368#comment-14328368

Demai Ni commented on HDFS-6994:

[~wheat9] and [~wangzw],

bq. Note that libhdfs3 is always available to the power users – they can check out the code
and compile it themselves. Given that I feel that there is no need rush declaring libhdfs3
is available without stabilizing the APIs first.

just to chime in here from a user perspective. My team used this libhdfs3 for POC since last
Oct, and is considering it for our production line. We did compile the code ourselves and
integrated with our code as [~wheat9] suggested, and tested intensively for the most common
APIs: connection, open/close file, read, seek, etc..   However, to use this code in production,
it is important for us to have the jira accepted by hdfs community. The reason is due to general
business/development process/guideline. Hence, we really love to see this jira committed and
ok to smaller changes later on API and error handling.

With that said, I am just a user and not expert in hdfs/hadoop area. If the design or code
quality of the jira is not ready yet, certainly it should wait.


> libhdfs3 - A native C/C++ HDFS client
> -------------------------------------
>                 Key: HDFS-6994
>                 URL: https://issues.apache.org/jira/browse/HDFS-6994
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: hdfs-client
>            Reporter: Zhanwei Wang
>            Assignee: Zhanwei Wang
>         Attachments: HDFS-6994-rpc-8.patch, HDFS-6994.patch
> Hi All
> I just got the permission to open source libhdfs3, which is a native C/C++ HDFS client
based on Hadoop RPC protocol and HDFS Data Transfer Protocol.
> libhdfs3 provide the libhdfs style C interface and a C++ interface. Support both HADOOP
RPC version 8 and 9. Support Namenode HA and Kerberos authentication.
> libhdfs3 is currently used by HAWQ of Pivotal
> I'd like to integrate libhdfs3 into HDFS source code to benefit others.
> You can find libhdfs3 code from github
> https://github.com/PivotalRD/libhdfs3
> http://pivotalrd.github.io/libhdfs3/

This message was sent by Atlassian JIRA

View raw message