hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "rajeshbabu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-9203) Secondary index support through coprocessors
Date Thu, 02 Jan 2014 12:04:59 GMT

    [ https://issues.apache.org/jira/browse/HBASE-9203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13860165#comment-13860165

rajeshbabu commented on HBASE-9203:

[~yuzhihong@gmail.com] Thanks for review.
bq. In figure CreateTableWithSplits, there is an arrow from CreateTableHandler to IndexMasterObserver
labeled CreateIndexTableCameout. I don't find such callback in the patch. What does the arrow
represent ?
Just wanted to represent coming back to IndexMasterObserver from CreateTableHandler. There
are no such call backs in the code, the arrow should start from CreateTableHandler(by mistake
drawn from HMaster).

bq. Can you explain the second sentence in more detail ?
Since the rowkey for the index table put is like this
startkey of index region + index name + indexed column(s) value(s) + user table rowkey 
The last two bytes represents  starting position of actual rowkey.

bq. IndexLoadIncrementalHFile is the utility that does the loading into index table.
Yes it should be IndexLoadIncrementalHFile utility. Nice catch Ted.

bq. Is IndexTsvImporterMapper this new class ?
Yes its IndexTsvImporterMapper. It will be used to prepare puts for both user table index
table from raw data.
IndexCreationMapper will be used to prepare index table puts from user table data. I will
add javadoc.

bq.  there is a dummy CF under .indexTable directory. What's its purpose ?
Actually it's column family in index table name. Didn't decide the name at that time so given
some name.

> Secondary index support through coprocessors
> --------------------------------------------
>                 Key: HBASE-9203
>                 URL: https://issues.apache.org/jira/browse/HBASE-9203
>             Project: HBase
>          Issue Type: New Feature
>            Reporter: rajeshbabu
>            Assignee: rajeshbabu
>         Attachments: SecondaryIndex Design.pdf, SecondaryIndex Design_Updated.pdf
> We have been working on implementing secondary index in HBase and open sourced  on hbase
0.94.8 version.
> The project is available on github.
> https://github.com/Huawei-Hadoop/hindex
> This Jira is to support secondary index on trunk(0.98).
> Following features will be supported.
> -          multiple indexes on table,
> -          multi column index,
> -          index based on part of a column value,
> -          equals and range condition scans using index, and
> -          bulk loading data to indexed table (Indexing done with bulk load)
> Most of the kernel changes needed for secondary index is available in trunk. Very minimal
changes needed for it.

This message was sent by Atlassian JIRA

View raw message