hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-16059) Region normalizer fails to trigger merge action where one of the regions is empty
Date Sat, 18 Jun 2016 00:31:05 GMT

    [ https://issues.apache.org/jira/browse/HBASE-16059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15337325#comment-15337325
] 

Ted Yu commented on HBASE-16059:
--------------------------------

{code}
Failed tests: 
  TestMultithreadedTableMapper.testMultithreadedTableMapper:132->runTestOnTable:155 null
Flaked tests: 
org.apache.hadoop.hbase.TestPartialResultsFromClientSide.testExpectedNumberOfCellsPerPartialResult(org.apache.hadoop.hbase.TestPartialResultsFromClientSide)
  Run 1: TestPartialResultsFromClientSide.testExpectedNumberOfCellsPerPartialResult » TableNotFound
  Run 2: PASS

org.apache.hadoop.hbase.client.TestRestoreSnapshotFromClient.testRestoreSchemaChange(org.apache.hadoop.hbase.client.TestRestoreSnapshotFromClient)
  Run 1: TestRestoreSnapshotFromClient.testRestoreSchemaChange:207->countRows:321 » Runtime
  Run 2: PASS

org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFiles.testRegionCrossingHFileSplitRowBloom(org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFiles)
  Run 1: TestLoadIncrementalHFiles.testRegionCrossingHFileSplitRowBloom:192->testRegionCrossingHFileSplit:227->runTest:259->runTest:269->runTest:295
» ScannerTimeout
  Run 2: PASS

org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2.testScanYYYToEmpty(org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2)
  Run 1: TestTableInputFormatScan2.testScanYYYToEmpty:97->TestTableInputFormatScanBase.testScan:240
» TableNotFound
  Run 2: PASS

org.apache.hadoop.hbase.regionserver.TestScannerRetriableFailure.testFaultyScanner(org.apache.hadoop.hbase.regionserver.TestScannerRetriableFailure)
  Run 1: TestScannerRetriableFailure.testFaultyScanner:113->checkTableRows:150 » ScannerTimeout
  Run 2: PASS

org.apache.hadoop.hbase.regionserver.wal.TestAsyncLogRollPeriod.testWithEdits(org.apache.hadoop.hbase.regionserver.wal.TestAsyncLogRollPeriod)
  Run 1: TestAsyncLogRollPeriod>AbstractTestLogRollPeriod.testWithEdits:124->Object.wait:-2
» TestTimedOut
  Run 2: PASS

org.apache.hadoop.hbase.regionserver.wal.TestAsyncLogRolling.testLogRollOnDatanodeDeath(org.apache.hadoop.hbase.regionserver.wal.TestAsyncLogRolling)
  Run 1: TestAsyncLogRolling.testLogRollOnDatanodeDeath:63 expected:<1> but was:<0>
  Run 2: PASS


Tests run: 1900, Failures: 1, Errors: 0, Skipped: 44, Flakes: 7
{code}
Failed test was not related to the patch.

> Region normalizer fails to trigger merge action where one of the regions is empty
> ---------------------------------------------------------------------------------
>
>                 Key: HBASE-16059
>                 URL: https://issues.apache.org/jira/browse/HBASE-16059
>             Project: HBase
>          Issue Type: Bug
>          Components: master
>            Reporter: Romil Choksi
>            Assignee: Ted Yu
>              Labels: normalization
>             Fix For: 2.0.0
>
>         Attachments: 16059.v1.txt
>
>
> Region normalizer failed to trigger merge action where expected
> Steps to reproduce:
> - Pre-split the test table into 5 regions with keys 1,3,7,8
> - Insert some data for each of the split. 27K rows for regions starting with key 1, and
100K rows for each of the regions with start key 3,7 and 8
> - Scan the test table, and verify that these regions exists -  1) STARTKEY => ‘'
ENDKEY => ’1’  2)  STARTKEY => ’1’ ENDKEY => ’3’
> - Turn on normalization, verify normalization switch is enabled and that normalization
is true for test table
> - Run normalizer a few times
> - Scan test table again, verify that regions don’t exist anymore  1) STARTKEY =>
‘' ENDKEY => ’1’  2)  STARTKEY => ’1’ ENDKEY => ’3’, but instead a
new region is created with  STARTKEY => ’’ ENDKEY => ’3’
> The test now fails, with the last step failing at assertion. 
> Looking into the Master log, I see that normalization plan was computed for the test
table but it decides that no normalization is needed for the test table, and that the regions
look good.
> {code:title = Master.log}
> 2016-06-17 00:41:46,895 DEBUG [B.defaultRpcServer.handler=4,queue=1,port=20000] normalizer.SimpleRegionNormalizer:
Computing normalization plan for table: table_zrof6ea383, number of regions: 5
> 2016-06-17 00:41:46,895 DEBUG [B.defaultRpcServer.handler=4,queue=1,port=20000] normalizer.SimpleRegionNormalizer:
Table table_zrof6ea383, total aggregated regions size: 13
> 2016-06-17 00:41:46,896 DEBUG [B.defaultRpcServer.handler=4,queue=1,port=20000] normalizer.SimpleRegionNormalizer:
Table table_zrof6ea383, average region size: 2.6
> 2016-06-17 00:41:46,896 DEBUG [B.defaultRpcServer.handler=4,queue=1,port=20000] normalizer.SimpleRegionNormalizer:
No normalization needed, regions look good for table: table_zrof6ea383
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message