hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Binglin Chang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-10390) DFSCIOTest looks for the wrong version of libhdfs
Date Mon, 10 Mar 2014 07:29:43 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13925511#comment-13925511
] 

Binglin Chang commented on HADOOP-10390:
----------------------------------------

Currently I think there are 3 issues we need to fix: 
1. libhdfs has a different path and version now, they should be updated
2. hdfs_read/hdfs_write no longer exists(at least not in hadoop distribution), but it is used
for DFSCIOTest, should they also go into distribution?
3. DFSCIOTest on exception only prints error message:
      System.err.print(e.getLocalizedMessage());
    it is so confusing that I took a long time to find the root cause



> DFSCIOTest looks for the wrong version of libhdfs
> -------------------------------------------------
>
>                 Key: HADOOP-10390
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10390
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 2.0.0-alpha
>            Reporter: wenwupeng
>            Assignee: Binglin Chang
>         Attachments: HADOOP-10390.v1.patch
>
>
> Run benckmark DFSCIOTest failed at libhdfs.so.1
> hadoop jar ./share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.3.0-tests.jar
DFSCIOTest -write -nrFiles 1 -fileSize 100
> DFSCIOTest.0.0.1
> 14/03/06 02:52:55 INFO fs.DFSCIOTest: nrFiles = 1
> 14/03/06 02:52:55 INFO fs.DFSCIOTest: fileSize (MB) = 100
> 14/03/06 02:52:55 INFO fs.DFSCIOTest: bufferSize = 1000000
> 14/03/06 02:52:55 WARN util.NativeCodeLoader: Unable to load native-hadoop library for
your platform... using builtin-java classes where applicable
> File /hadoop/hadoop-smoke/libhdfs/libhdfs.so.1 does not exist
> can get libhdfs.so.0.0.0 under ./lib/native
> [root@namenode hadoop-smoke]# find ./ -name libhdfs*
> ./lib/native/libhdfs.so
> ./lib/native/libhdfs.so.0.0.0
> ./lib/native/libhdfs.a



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message