lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Earwin Burrfoot <ear...@gmail.com>
Subject Re: custom segment files
Date Fri, 18 Sep 2009 07:55:05 GMT
I bet custom per-segment files could very well be used for per-segment
userdata/debuginfo we introduced earlier.
With them it could be stored neatly in a separate file instead of
being grafted onto current ones.

On Thu, Sep 17, 2009 at 18:35, Michael McCandless
<lucene@mikemccandless.com> wrote:
> I'm actively working on LUCENE-1458, to enable differenct codecs for
> reading/writing the terms dict and doc/freq/prox/payload postings.
> I'm working now towards getting PforDelta working...
>
> However, that change doesn't [yet] do anything for norms, stored
> fields nor term vectors.
>
> Can you describe more details about what kinds of customization you're
> looking to do?
>
> Mike
>
> On Thu, Sep 17, 2009 at 10:00 AM, John Wang <john.wang@gmail.com> wrote:
>> Hi guys:
>>
>>      I am trying to figure how to add the ability to create custom segment
>> files. Hopefully it is possible to create a plugin framework where one can
>> provide some sort of callback to add to a segment given a doc and provide
>> some sort of merge logic. This is in light of the flexible indexing effort.
>>
>>      After digging thru the latest trunk code in that area, I see a
>> Writer/WriterPerThread pattern for different types of segment files, e.g.
>> Stored data, norms, inverted doc, etc.
>>
>>      Do you think it is a good idea to consolidate them? Are there
>> intricacies where there are cross dependency between different types of
>> writers?
>>
>>      Merge logic seems to be in the SegmentMerger class. Seems to do this,
>> it would be good to separate it out to per writer type.
>>
>>       I am still trying to understand the code, any help is greatly
>> appreciated.
>>
>> Thoughts?
>>
>> Thanks
>>
>> -John
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-dev-help@lucene.apache.org
>
>



-- 
Kirill Zakharenko/Кирилл Захаренко (earwin@gmail.com)
Home / Mobile: +7 (495) 683-567-4 / +7 (903) 5-888-423
ICQ: 104465785

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message