hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Henry Robinson (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-3110) libhdfs implementation of direct read API
Date Thu, 05 Apr 2012 23:08:24 GMT

    [ https://issues.apache.org/jira/browse/HDFS-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13247816#comment-13247816

Henry Robinson commented on HDFS-3110:

Yeah, the tests aren't wired into the pom yet (there is a TODO in hadoop-hdfs/pom.xml). We
should create a follow-on JIRA to put this back in the build process.

Here's how I built. Make sure HADOOP_HOME is set.

*From hadoop-hdfs/src/main/native:*

export LD_LIBRARY_PATH=/usr/lib/jvm/java-6-sun-${HADOOP_HOME}/lib/native/

export LIBHDFS_OPTS=-Djava.library.path=${HADOOP_HOME}/lib/native/

gcc -Wall hdfs_test.c -I/usr/lib/jvm/java-6-sun- -I/usr/lib/jvm/java-6-sun-
-L${HADOOP_HOME}/lib/native/ -lhdfs -ljvm -L/usr/lib/jvm/java-6-sun-

and to test:

*From hadoop-hdfs/src/main/native/tests*

> libhdfs implementation of direct read API
> -----------------------------------------
>                 Key: HDFS-3110
>                 URL: https://issues.apache.org/jira/browse/HDFS-3110
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: libhdfs
>            Reporter: Henry Robinson
>            Assignee: Henry Robinson
>             Fix For: 0.24.0
>         Attachments: HDFS-3110.0.patch, HDFS-3110.1.patch, HDFS-3110.2.patch, HDFS-3110.3.patch,
HDFS-3110.4.patch, HDFS-3110.5.patch
> Once HDFS-2834 gets committed, we can add support for the new API to libhdfs, which leads
to significant performance increases when reading local data from C.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message