hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anoop Sam John (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-17777) TestMemstoreLAB#testLABThreading runs too long for a small test
Date Mon, 13 Mar 2017 16:22:13 GMT

    [ https://issues.apache.org/jira/browse/HBASE-17777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15907758#comment-15907758

Anoop Sam John commented on HBASE-17777:

With out reducing the #threads and chunk, if we can reduce the test timing just by reducing
the cell's size, then it should be done. Hope there is no need to reduce #cells written too.

> TestMemstoreLAB#testLABThreading runs too long for a small test
> ---------------------------------------------------------------
>                 Key: HBASE-17777
>                 URL: https://issues.apache.org/jira/browse/HBASE-17777
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>    Affects Versions: 2.0.0
>            Reporter: ramkrishna.s.vasudevan
>            Assignee: ramkrishna.s.vasudevan
>            Priority: Minor
> While working on ChunkCreator/ChunkMap found that the test in TestMSLAB#testLABThreading()
runs for almost 5 mins and the whole test is under smallTest category.
> The reason is that we are creating 35*2MB chunks from MSLAB. We try writing data to these
chunks until they are 50MB in size.
> And while verifying in order to check if the chunks are not overwritten/overlapped we
verify the content of the buffers.
> So we actually keep comparing 50MB buffer n  number of times. I suggest we change this
in a way that at max we create chunks whose size is totally at 1MB or may be even lesser and
write cells which are smaller in size. By doing this we can drastically reduce the run time
of this test. May be something less than 1 min.

This message was sent by Atlassian JIRA

View raw message