hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jiraposter@reviews.apache.org (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-4321) Add more comprehensive region split calculator
Date Tue, 06 Sep 2011 01:13:11 GMT

    [ https://issues.apache.org/jira/browse/HBASE-4321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13097678#comment-13097678
] 

jiraposter@reviews.apache.org commented on HBASE-4321:
------------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/1703/#review1758
-----------------------------------------------------------


what do you mean about changing HRegionInfo writable? Adding another "implements" should be
fine. If you change the serialization _format_ it's more problematic.


src/main/java/org/apache/hadoop/hbase/util/RegionSplitCalculator.java
<https://reviews.apache.org/r/1703/#comment3996>

    this won't work. you'd need an infinitely long string of 0xffs to be at the end. I guess
the comparisonchain is pretty but won't work, sorry for leading you astray



src/test/java/org/apache/hadoop/hbase/util/TestRegionSplitCalculator.java
<https://reviews.apache.org/r/1703/#comment3994>

    My thinking about the interface is that this comparator could actually work on anything
that implements that interface. ie move this to be a static KeyRange.COMPARATOR, and then
the Calculator doesn't need to take a comparator argument anymore, right?



src/test/java/org/apache/hadoop/hbase/util/TestRegionSplitCalculator.java
<https://reviews.apache.org/r/1703/#comment3995>

    remove empty javadoc



src/test/java/org/apache/hadoop/hbase/util/TestRegionSplitCalculator.java
<https://reviews.apache.org/r/1703/#comment3993>

    what's this funky character?


- Todd


On 2011-09-05 23:34:14, jmhsieh wrote:
bq.  
bq.  -----------------------------------------------------------
bq.  This is an automatically generated e-mail. To reply, visit:
bq.  https://reviews.apache.org/r/1703/
bq.  -----------------------------------------------------------
bq.  
bq.  (Updated 2011-09-05 23:34:14)
bq.  
bq.  
bq.  Review request for hbase, Todd Lipcon and Michael Stack.
bq.  
bq.  
bq.  Summary
bq.  -------
bq.  
bq.  This is the core region split calculator.  It provides a sorted set of region split points,
and a "coverage" multimap.  This is enough information to properly determine dupe start keys,
all the different kinds of overlap, as well as holes.
bq.  
bq.  
bq.  This addresses bug hbase-4321.
bq.      https://issues.apache.org/jira/browse/hbase-4321
bq.  
bq.  
bq.  Diffs
bq.  -----
bq.  
bq.    src/main/java/org/apache/hadoop/hbase/util/KeyRange.java PRE-CREATION 
bq.    src/main/java/org/apache/hadoop/hbase/util/RegionSplitCalculator.java PRE-CREATION

bq.    src/test/java/org/apache/hadoop/hbase/util/TestRegionSplitCalculator.java PRE-CREATION

bq.  
bq.  Diff: https://reviews.apache.org/r/1703/diff
bq.  
bq.  
bq.  Testing
bq.  -------
bq.  
bq.  Unit tests just checks algorithm, no dependencies on HBase yet.
bq.  
bq.  
bq.  Thanks,
bq.  
bq.  jmhsieh
bq.  
bq.



> Add more comprehensive region split calculator
> ----------------------------------------------
>
>                 Key: HBASE-4321
>                 URL: https://issues.apache.org/jira/browse/HBASE-4321
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 0.90.4
>            Reporter: Jonathan Hsieh
>            Assignee: Jonathan Hsieh
>         Attachments: 0001-HBASE-4321-Add-more-comprehensive-region-split-calcu.patch,
hbase-4321.diff
>
>
> Hbck currently scans through meta one entry at a time, only keeping a reference to the
previous meta entry.  This is insufficient for capturing all the possible problems in meta
and needs something more to properly identify holes, overlaps, duplicate start keys, and otherwise
invalid meta entries.
> Ideally, this calculator could also be used online interrogating an existing meta (HBASE-4058),
and also used to generate a completely new meta offline just from regioninfo and in hdfs (HBASE-3505).


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message