hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Binglin Chang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-10390) DFSCIOTest looks for the wrong version of libhdfs
Date Mon, 10 Mar 2014 07:07:45 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13925499#comment-13925499
] 

Binglin Chang commented on HADOOP-10390:
----------------------------------------

I reviewed code carefully, related code:
{code}
        fs.copyFromLocalFile(new Path(hadoopHome + "/libhdfs/libhdfs.so." + HDFS_LIB_VERSION),
                             HDFS_SHLIB);
        fs.copyFromLocalFile(new Path(hadoopHome + "/libhdfs/hdfs_read"), HDFS_READ);
        fs.copyFromLocalFile(new Path(hadoopHome + "/libhdfs/hdfs_write"), HDFS_WRITE);
{code}
the program try to copy hadoopHome/libhdfs/libhdfs.so to HDFS and failed, because file doesn't
exists.
Actually the whole path is not right, I suspect the path(HADOOP_HOME/libhdfs/libhdfs.so|hdfs_read|hdfs_write)
is already out-of-date now(maybe they exist in hadoop-v1 test environments), so in theory
the test should fail for a long time ago.


> DFSCIOTest looks for the wrong version of libhdfs
> -------------------------------------------------
>
>                 Key: HADOOP-10390
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10390
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 2.0.0-alpha
>            Reporter: wenwupeng
>            Assignee: Binglin Chang
>         Attachments: HADOOP-10390.v1.patch
>
>
> Run benckmark DFSCIOTest failed at libhdfs.so.1
> hadoop jar ./share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.3.0-tests.jar
DFSCIOTest -write -nrFiles 1 -fileSize 100
> DFSCIOTest.0.0.1
> 14/03/06 02:52:55 INFO fs.DFSCIOTest: nrFiles = 1
> 14/03/06 02:52:55 INFO fs.DFSCIOTest: fileSize (MB) = 100
> 14/03/06 02:52:55 INFO fs.DFSCIOTest: bufferSize = 1000000
> 14/03/06 02:52:55 WARN util.NativeCodeLoader: Unable to load native-hadoop library for
your platform... using builtin-java classes where applicable
> File /hadoop/hadoop-smoke/libhdfs/libhdfs.so.1 does not exist
> can get libhdfs.so.0.0.0 under ./lib/native
> [root@namenode hadoop-smoke]# find ./ -name libhdfs*
> ./lib/native/libhdfs.so
> ./lib/native/libhdfs.so.0.0.0
> ./lib/native/libhdfs.a



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message