hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9030) libwebhdfs lacks headers, documentation; not part of mvn package
Date Tue, 08 Sep 2015 20:15:46 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14735528#comment-14735528

Allen Wittenauer commented on HDFS-9030:

Merging HDFS-9029 into this.

Digging into this today, I realize what an INCREDIBLY short sighted thing we've done.

Basically, libhdfs and libwebhdfs are interchangeable at link time since they expose the exact
same APIs.  On the surface, this appears like a great, convinent feature:

* hdfs.h is the same header for both libraries
* API calls are the same so documentation is the same.

* Users CANNOT (effectively) link both libraries in the same program

So your program either does HDFS RPC or WebHDFS REST.  It cannot do both.  Worse, neither
library actually exposes all of the APIs that have been declared public.  (I'm looking at
you, snapshots).

It might be a blessing in disguise that this hasn't been exposed very widely due to libwebhdfs
not actually showing up in the tarballs.

> libwebhdfs lacks headers, documentation; not part of mvn package
> ----------------------------------------------------------------
>                 Key: HDFS-9030
>                 URL: https://issues.apache.org/jira/browse/HDFS-9030
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 3.0.0
>            Reporter: Allen Wittenauer
>            Priority: Blocker
> This library is useless without header files to include and documentation on how to use
it.  Both appear to be missing from the mvn package and site documentation.

This message was sent by Atlassian JIRA

View raw message