hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Íñigo Goiri (JIRA) <j...@apache.org>
Subject [jira] [Commented] (HADOOP-15475) Fix broken unit tests on Windows
Date Tue, 29 May 2018 16:29:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-15475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16493803#comment-16493803
] 

Íñigo Goiri commented on HADOOP-15475:
--------------------------------------

A couple more builds:

||Run||Date||Total||Skipped||Failed||Passed||
|[459|https://builds.apache.org/job/hadoop-trunk-win/459/testReport/]|2018/05/06|19386|1465|846|17075|
|[460|https://builds.apache.org/job/hadoop-trunk-win/460/testReport/]|2018/05/07|16906|1418|754|14734|
|[463|https://builds.apache.org/job/hadoop-trunk-win/463/testReport/]|2018/05/10|19252|1472|540|17240|
|[467|https://builds.apache.org/job/hadoop-trunk-win/467/testReport/]|2018/05/14|19317|1472|573|17272|
|[469|https://builds.apache.org/job/hadoop-trunk-win/469/testReport/]|2018/05/16|19326|1472|516|17388|
|[476|https://builds.apache.org/job/hadoop-trunk-win/476/testReport/]|2018/05/23|19355|1473|446|17436|
|[479|https://builds.apache.org/job/hadoop-trunk-win/479/testReport/]|2018/05/26|19384|1473|375|17536|
|[481|https://builds.apache.org/job/hadoop-trunk-win/481/testReport/]|2018/05/23|19409|1472|405|17532|

Last week we resolved a couple JIRAs with a lot of failures in them so we reduced by more
than 50.
>From build #479 to #481 there was an increase in failed unit tests but I think it's because
of flaky unit tests that we should eventually fix too.
We have been mostly focusing on HDFS so far and now we should try to target commons, YARN
and MapReduce more.
For YARN there are a lot of tests that we are Linux specific and we are thinking to disable
in YARN-8359.


> Fix broken unit tests on Windows
> --------------------------------
>
>                 Key: HADOOP-15475
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15475
>             Project: Hadoop Common
>          Issue Type: Test
>            Reporter: Anbang Hu
>            Assignee: Anbang Hu
>            Priority: Minor
>              Labels: Windows
>
> There are hundreds of unit tests that fail on Windows. This JIRA tracks the effort to
fix them.
> The main reasons for unit test failures on Windows are:
> * Windows/Linux path formats (e.g., HDFS-10256).
> * Line separator.
> * Locked files: Windows locks files when opening them.
> ** The typical trigger is not cleaning MiniDFSCluster leaves files locked when a test
times out; they need to be cleaned using After.
> * Memory lock size.
> * Slow DNS resolution (e.g., HDFS-13569).
> * Locked ports (e.g., HDFS-11700)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message