mesos-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yan Xu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MESOS-4558) Reduce the running time of benchmark tests.
Date Wed, 13 Jul 2016 08:09:20 GMT

    [ https://issues.apache.org/jira/browse/MESOS-4558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15374570#comment-15374570
] 

Yan Xu commented on MESOS-4558:
-------------------------------

Looking at the [parameterization of allocator benchmarks|https://github.com/apache/mesos/blob/c40e48897f05c130427758d75e593a793c7f47ae/src/tests/hierarchical_allocator_tests.cpp#L3276-L3284],
I feel that we don't possibly need all combinations of these frameworkCount/agentCount numbers
on ASF CI. We need a selective few which are representative. When I run the test I would typically
filter it like {{SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/10}},
can we configure ASF CI to only run a subset of parameter combinations?

The downside of this is when we add new tests we need to reconfigure ASF CI to select what
we run. Alternatively we could establish a convention to name benchmarks that we would like
to run on CI (ASF or not) as part of *acceptance testing* so we can just filter on the convention.
Notice the {{SlaveAndFrameworkCount}} in the example is an instantiation name which could
be used for the name convention. This makes more sense to me because the reason you want to
run some benchmarks on CI is to automate a form a performance acceptance test: its scope is
narrower than "all benchmarks" so additional filtering is applied.

e.g., we can do this
{code}
MESOS_BENCHMARK=1 GTEST_FILTER="*CI_*BENCHMARK*" make check
{code}



> Reduce the running time of benchmark tests.
> -------------------------------------------
>
>                 Key: MESOS-4558
>                 URL: https://issues.apache.org/jira/browse/MESOS-4558
>             Project: Mesos
>          Issue Type: Task
>            Reporter: Vinod Kone
>              Labels: newbie++
>
> Currently benchmark tests take a long time (>5 hours). It would be nice to reduce
the total time taken by the benchmark tests to enable us to run them on ASF CI.
> Command to run only benchmark tests
> {code}
> MESOS_BENCHMARK=1 GTEST_FILTER="*BENCHMARK*" make check
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message