phoenix-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PHOENIX-5336) Speed up MutableIndexSplitForwardScanIT and MutableIndexSplitReverseScanIT
Date Wed, 12 Jun 2019 05:32:00 GMT

    [ https://issues.apache.org/jira/browse/PHOENIX-5336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16861765#comment-16861765
] 

Lars Hofhansl commented on PHOENIX-5336:
----------------------------------------

Of course most of the time is spent waiting so no CPU is taken from tests running in parallel,
but this is taking two "slots" in which maven could schedule two other tests for 15 minutes
each.

> Speed up MutableIndexSplitForwardScanIT and MutableIndexSplitReverseScanIT
> --------------------------------------------------------------------------
>
>                 Key: PHOENIX-5336
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-5336
>             Project: Phoenix
>          Issue Type: Sub-task
>    Affects Versions: 4.15.0, 5.1.0
>            Reporter: Lars Hofhansl
>            Assignee: Lars Hofhansl
>            Priority: Major
>         Attachments: 5336.txt
>
>
> I observed that these tests are slow because we wait after the split until the parent
has been compacted away. It's not necessary to do so (unless we wanted to test that specific
HBase logic and HBase already has many tests for that). We can change the test to only wait
until the daughter regions are created. When they exist they will be used.
> Avoiding that waiting cuts the runtime of each test from 17mins to 2min (on my machine)
so it saves at least 30mins of runtime (and more on the slower jenkins machines)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message