hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mickael Olivier (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6515) testPageRounder (org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache)
Date Mon, 07 Jul 2014 12:39:34 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14053603#comment-14053603

Mickael Olivier commented on HDFS-6515:

The test class that failed because of a timeout seems unreleated to my modifications as it
does not seem to have anything to do with the filesystem. I cannot retrieve it on Jenkins
test results, and on eclipse I see a TestHttpServer that is in the http package, not the hdfs

Other tests that were not skipped seem to path without any failure, but the console output
log is disturbing as there are several weird exceptions. I wonder weither it is possible to
resubmit the patch using -X option or not.

Errors I found are :

hdfsOpenFile(/tlhData0001/file1): FileSystem#open((Lorg/apache/hadoop/fs/Path;I)Lorg/apache/hadoop/fs/FSDataInputStream;)
hdfsOpenFile(/tlhData0002/file1): FileSystem#open((Lorg/apache/hadoop/fs/Path;I)Lorg/apache/hadoop/fs/FSDataInputStream;)
ERROR: cannot open an hdfs file in mode 0x3
java.io.FileNotFoundException: File does not exist: /tlhData0002/file1
ERROR: cannot open an hdfs file in mode 0x3
hdfsOpenFile(/tlhData0000/file1): FileSystem#open((Lorg/apache/hadoop/fs/Path;I)Lorg/apache/hadoop/fs/FSDataInputStream;)

But these might not be what we are looking for.

On the other hand, the only reference to TestHttpServer is :

Running org.apache.hadoop.http.TestHttpServer

When running mvn -Dtest=TestHttpServer test -X on my ubuntu VB, and on my ppc (RHEL 6.5),
it successfully builds on my side.
What kind of environment are you using for testing ?

> testPageRounder   (org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache)
> -----------------------------------------------------------------------------
>                 Key: HDFS-6515
>                 URL: https://issues.apache.org/jira/browse/HDFS-6515
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode
>    Affects Versions: 3.0.0, 2.4.0
>         Environment: Linux on PPC64
>            Reporter: Tony Reix
>            Priority: Blocker
>              Labels: test
>         Attachments: HDFS-6515-1.patch
> I have an issue with test :
>    testPageRounder
>   (org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache)
> on Linux/PowerPC.
> On Linux/Intel, test runs fine.
> On Linux/PowerPC, I have:
> testPageRounder(org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache)  Time elapsed:
64.037 sec  <<< ERROR!
> java.lang.Exception: test timed out after 60000 milliseconds
> Looking at details, I see that some "Failed to cache " messages appear in the traces.
Only 10 on Intel, but 186 on PPC64.
> On PPC64, it looks like some thread is waiting for something that never happens, generating
a TimeOut.
> I'm now using IBM JVM, however I've just checked that the issue also appears with OpenJDK.
> I'm now using Hadoop latest, however, the issue appeared within Hadoop 2.4.0 .
> I need help for understanding what the test is doing, what traces are expected, in order
to understand what/where is the root cause.

This message was sent by Atlassian JIRA

View raw message