hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Íñigo Goiri (JIRA) <j...@apache.org>
Subject [jira] [Commented] (HADOOP-15475) Fix broken unit tests on Windows
Date Thu, 24 May 2018 16:38:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-15475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16489337#comment-16489337
] 

Íñigo Goiri commented on HADOOP-15475:
--------------------------------------

{quote}My ASF volunteer time is almost exclusively for other projects. As a result, Hadoop
builds are pretty much off my radar entirely. Sorry.
{quote}
Sure, I'll work with [~chris.douglas] on checking the build.
 Feel free to provide feedback in this thread too.

Funny, enough the daily Windows build worked [yesterday|https://builds.apache.org/job/hadoop-trunk-win/476/testReport/].
This includes a couple big fixes like HDFS-13586 which reduced the number of failed unit tests
from 516 to 446.
Internally our errors in branch-2.9 on Windows are 239.
The evolution is as follows:

||Run||Date||Total||Skipped||Failed||Passed||
|[459|https://builds.apache.org/job/hadoop-trunk-win/459/testReport/]|2018/05/06|19386|1465|846|17075|
|[460|https://builds.apache.org/job/hadoop-trunk-win/460/testReport/]|2018/05/07|16906|1418|754|14734|
|[463|https://builds.apache.org/job/hadoop-trunk-win/463/testReport/]|2018/05/10|19252|1472|540|17240|
|[467|https://builds.apache.org/job/hadoop-trunk-win/467/testReport/]|2018/05/14|19317|1472|573|17272|
|[469|https://builds.apache.org/job/hadoop-trunk-win/469/testReport/]|2018/05/16|19326|1472|516|17388|
|[476|https://builds.apache.org/job/hadoop-trunk-win/476/testReport/]|2018/05/23|19355|1473|446|17436|

The unit tests with the most failures at this point are:
 * TestHDFSFileSystemContract 44 failures: issues and deleting paths, I'm guessing a failed
unit test locks it
 * TestAuditLoggerWithCommands 40 failures: I think this must be line separator on Windows
 * TestRawLocalFileSystemContract 21 failures: related to the path
 * TestMetadataStore 18 failures

> Fix broken unit tests on Windows
> --------------------------------
>
>                 Key: HADOOP-15475
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15475
>             Project: Hadoop Common
>          Issue Type: Test
>            Reporter: Anbang Hu
>            Assignee: Anbang Hu
>            Priority: Minor
>
> There are hundreds of unit tests that fail on Windows. This JIRA tracks the effort to
fix them.
> The main reasons for unit test failures on Windows are:
> * Windows/Linux path formats (e.g., HDFS-10256).
> * Line separator.
> * Locked files: Windows locks files when opening them.
> ** The typical trigger is not cleaning MiniDFSCluster leaves files locked when a test
times out; they need to be cleaned using After.
> * Memory lock size.
> * Slow DNS resolution (e.g., HDFS-13569).
> * Locked ports (e.g., HDFS-11700)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message