hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Da Zhou (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-15714) tune abfs/wasb parallel the sequential test execution
Date Tue, 04 Sep 2018 18:03:01 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-15714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16603395#comment-16603395
] 

Da Zhou commented on HADOOP-15714:
----------------------------------

Submitting the patch :HADOOP-15714-HADOOP-15407-001.patch:
Reverting back to only having one parallel-tests property

Run both WASB and ABFS in parallel:  
{code:java}
mvn -T 1C -Dparallel-tests=both -Dscale  -DtestsThreadCount=8 clean verify
{code}

Run WASB in parallel: 
{code:java}
mvn -T 1C -Dparallel-tests=abfs  -Dscale  -DtestsThreadCount=8 clean verify
{code}

Run ABFS in parallel:
{code:java}
 mvn -T 1C -Dparallel-tests=wasb -Dscale  -DtestsThreadCount=8 clean verify
{code}


> tune abfs/wasb parallel the sequential test execution
> -----------------------------------------------------
>
>                 Key: HADOOP-15714
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15714
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/azure
>            Reporter: Steve Loughran
>            Assignee: Da Zhou
>            Priority: Major
>             Fix For: HADOOP-15407
>
>         Attachments: HADOOP-15714-HADOOP-15407-001.patch
>
>
> after HADOOP-15664, sequential tests don't run unless you ask for them with the sequential
tests profile, as there are now separate profiles for parallel-tests, parallel-tests-abfs
and parallel-tests-wasb, so the sequential-tests profile can't just run if !parallel-tests
> Proposed: revert back to only having one parallel-tests property, but allow it to take
the values "abfs" and "wasb" to explicitly enable on those suites.
> This would add the set of options
> * -Dparallel-tests : all tests in parallel   (== true at runtime)
> * -Dparallel-tests=abfs   abfs tests only
> * -Dparallel-tests=wasb wasb tests only
> * "" : nothing defined, sequential
> the activations of the profiles would then look at the values in their activation; sequential-tests
would be triggered if it was unset.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message