hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Akira Ajisaka (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-13514) Upgrade maven surefire plugin to 2.19.1
Date Wed, 18 Oct 2017 01:46:02 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-13514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Akira Ajisaka updated HADOOP-13514:
-----------------------------------
    Attachment: HADOOP-13514.005.patch

Thanks [~steve_l] for the review. Updated the patch.
There is probably one more issue. After committing 003 patch, many RM tests timed out.
https://lists.apache.org/thread.html/3cdeeed93e903fbc1adacbc1c0cfbca4eecf93200907b5d42dc6d040@%3Ccommon-dev.hadoop.apache.org%3E
{noformat}
Timed out junit tests :

       org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.conf.TestZKConfigurationStore

       org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.TestRMContainerImpl 
       org.apache.hadoop.yarn.server.resourcemanager.TestRMRestart 
       org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler

       org.apache.hadoop.yarn.server.resourcemanager.scheduler.TestAbstractYarnScheduler 
       org.apache.hadoop.yarn.server.resourcemanager.TestRMHA 
       org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestNodeLabelContainerAllocation

       org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler 
       org.apache.hadoop.yarn.server.resourcemanager.recovery.TestFSRMStateStore 
       org.apache.hadoop.yarn.server.resourcemanager.recovery.TestZKRMStateStore 
       org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesAppsModification

       org.apache.hadoop.yarn.server.resourcemanager.TestApplicationMasterService 
       org.apache.hadoop.yarn.server.resourcemanager.TestResourceTrackerService 
       org.apache.hadoop.yarn.server.resourcemanager.TestLeaderElectorService 
       org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesReservation 
       org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestLeafQueue 
       org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesSchedulerActivities

       org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesApps 
       org.apache.hadoop.yarn.server.resourcemanager.TestRMProxyUsersConf 
       org.apache.hadoop.yarn.server.resourcemanager.TestContainerResourceUsage 
       org.apache.hadoop.yarn.server.resourcemanager.TestSubmitApplicationWithRMHA 
       org.apache.hadoop.yarn.server.resourcemanager.rmapp.TestApplicationLifetimeMonitor

       org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacitySchedulerAsyncScheduling

       org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer

       org.apache.hadoop.yarn.server.resourcemanager.applicationsmanager.TestAMRestart 
       org.apache.hadoop.yarn.server.resourcemanager.recovery.TestZKRMStateStorePerf 
       org.apache.hadoop.yarn.server.resourcemanager.TestWorkPreservingRMRestart 
       org.apache.hadoop.yarn.server.resourcemanager.security.TestAMRMTokens 
       org.apache.hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer 
       org.apache.hadoop.yarn.client.api.impl.TestAMRMClient
{noformat}
After reverting the patch, the timeout does not occur.
https://lists.apache.org/thread.html/a7140996c10c8681acb0b877cf632d5ee2490bb414fc95edbb75a93a@%3Ccommon-dev.hadoop.apache.org%3E

> Upgrade maven surefire plugin to 2.19.1
> ---------------------------------------
>
>                 Key: HADOOP-13514
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13514
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>    Affects Versions: 2.8.0
>            Reporter: Ewan Higgs
>            Assignee: Akira Ajisaka
>         Attachments: HADOOP-13514-addendum.01.patch, HADOOP-13514-testing.001.patch,
HADOOP-13514-testing.002.patch, HADOOP-13514-testing.003.patch, HADOOP-13514-testing.004.patch,
HADOOP-13514.002.patch, HADOOP-13514.003.patch, HADOOP-13514.004.patch, HADOOP-13514.005.patch,
surefire-2.19.patch
>
>
> A lot of people working on Hadoop don't want to run all the tests when they develop;
only the bits they're working on. Surefire 2.19 introduced more useful test filters which
let us run a subset of the tests that brings the build time down from 'come back tomorrow'
to 'grab a coffee'.
> For instance, if I only care about the S3 adaptor, I might run:
> {code}
> mvn test -Dmaven.javadoc.skip=true -Pdist,native -Djava.awt.headless=true \"-Dtest=org.apache.hadoop.fs.*,
org.apache.hadoop.hdfs.*, org.apache.hadoop.fs.s3a.*\"
> {code}
> We can work around this by specifying the surefire version on the command line but it
would be better, imo, to just update the default surefire used.
> {code}
> mvn test -Dmaven.javadoc.skip=true -Pdist,native -Djava.awt.headless=true \"-Dtest=org.apache.hadoop.fs.*,
org.apache.hadoop.hdfs.*, org.apache.hadoop.fs.s3a.*\" -Dmaven-surefire-plugin.version=2.19.1
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message