hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Henning Blohm <henning.bl...@zfabrik.de>
Subject Re: secondary index feature
Date Mon, 23 Dec 2013 11:13:16 GMT
Thanks for pointing to Lily. I read about it, but it seems to add 
significant additional infrastructure, which I am trying to avoid out of 
fear of adding unwanted complexity. That may be unjustified, and I may 
need to take another look.

Henning


On 22.12.2013 17:41, Anoop John wrote:
> HIndex is local indexing mechanism. It is per region indexing. Pheonix is
> not yet having a local indexing mechanism.(Global indexing is in
> place) Phoenix team do have roadmap for that.
>
>   You have done some thing like Lily  Henning?
>
> -Anoop-
>   m
> On Sun, Dec 22, 2013 at 9:39 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>
>> The library from Huawei is the basis for HBASE-10222
>> Rajeshbabu works for Huawei.
>>
>> Cheers
>>
>>
>> On Sun, Dec 22, 2013 at 8:00 AM, Pradeep Gollakota <pradeepg26@gmail.com
>>> wrote:
>>> I lied in my previous email... it doesn't look like Phoenix uses HIndex.
>>>
>>>
>>> On Sun, Dec 22, 2013 at 3:53 PM, Pradeep Gollakota <pradeepg26@gmail.com
>>>> wrote:
>>>> Take a look at this library from Huawei. They went a step further to
>>>> colocate the index with the primary partition. I believe Phoenix uses
>> it
>>>> for its indexing.
>>>>
>>>> https://github.com/Huawei-Hadoop/hindex
>>>>
>>>>
>>>> On Sun, Dec 22, 2013 at 1:34 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>>>>
>>>>> Rajeshbabu is working on HBASE-10222 which adds support of secondary
>>>>> index to HBASE core.
>>>>>
>>>>> FYI
>>>>>
>>>>> On Dec 22, 2013, at 2:11 AM, Henning Blohm <henning.blohm@zfabrik.de>
>>>>> wrote:
>>>>>
>>>>>> Lately we have added a secondary index feature to a persistence tier
>>>>> over HBASE. Essentially we implemented what is described as
>> "Dual-Write
>>>>> Secondary Index" in
>> http://hbase.apache.org/book/secondary.indexes.html
>>> .
>>>>> I.e. while updating an entity, actually before writing the actual
>>> update,
>>>>> indexes are updated. Lookup via the index ignores stale entries. A
>>>>> recurring rebuild and clean out of stale entries takes care the
>> indexes
>>> are
>>>>> trimmed and accurate.
>>>>>> None of this was terribly complex to implement. In fact, it seemed
>>> like
>>>>> something you could do generically, maybe not on the HBASE level
>> itself,
>>>>> but as a toolbox / utility style library.
>>>>>> Is anybody on the list aware of anything useful already existing
in
>>>>> that space?
>>>>>> Thanks,
>>>>>> Henning Blohm
>>>>>>
>>>>>> *ZFabrik Software KG*
>>>>>>
>>>>>> T:    +49 6227 3984255<https://mail.google.com/mail/u/0/html/compose/static_files/blank_quirks.html#>
>>>>>> F:    +49 6227 3984254<https://mail.google.com/mail/u/0/html/compose/static_files/blank_quirks.html#>
>>>>>> M:    +49 1781891820<https://mail.google.com/mail/u/0/html/compose/static_files/blank_quirks.html#>
>>>>>>
>>>>>> Lammstrasse 2 69190 Walldorf
>>>>>>
>>>>>> henning.blohm@zfabrik.de <mailto:henning.blohm@zfabrik.de>
>>>>>> Linkedin <http://www.linkedin.com/pub/henning-blohm/0/7b5/628>
>>>>>> ZFabrik <http://www.zfabrik.de>
>>>>>> Blog <http://www.z2-environment.net/blog>
>>>>>> Z2-Environment <http://www.z2-environment.eu>
>>>>>> Z2 Wiki <http://redmine.z2-environment.net>
>>>>>>
>>>>


-- 
Henning Blohm

*ZFabrik Software KG*

T: 	+49 6227 3984255
F: 	+49 6227 3984254
M: 	+49 1781891820

Lammstrasse 2 69190 Walldorf

henning.blohm@zfabrik.de <mailto:henning.blohm@zfabrik.de>
Linkedin <http://www.linkedin.com/pub/henning-blohm/0/7b5/628>
ZFabrik <http://www.zfabrik.de>
Blog <http://www.z2-environment.net/blog>
Z2-Environment <http://www.z2-environment.eu>
Z2 Wiki <http://redmine.z2-environment.net>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message