incubator-blur-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron McCurry (JIRA)" <>
Subject [jira] [Commented] (BLUR-148) Need to warm up new segments after NRT reloads
Date Sat, 22 Jun 2013 03:33:21 GMT


Aaron McCurry commented on BLUR-148:

Take a look at the org.apache.blur.manager.indexserver.DefaultBlurIndexWarmup class.  This
class walks through all the indexreader and warming each field as needed or configured after
the index has been opened in a shard server.  And what I mean by warming is that it calculates
via sampling where information for the given fields reside each file in the Directory.  After
it has calculated the offsets, the DefaultBlurIndexWarmup class will read in small blocks
the proper positions in the files to populate the BlockCache.

The org.apache.blur.manager.writer.FieldBasedWarmer class is used to warm only the new segments
that have been loaded by the NRT updates in the IndexWriter.  The goal is to have the FieldBasedWarmer
class warm the new segments the same way the DefaultBlurIndexWarmup warms the whole index.
 So basically we need to copy much of the logic in the DefaultBlurIndexWarmup class into the
FieldBasedWarmer class.

> Need to warm up new segments after NRT reloads
> ----------------------------------------------
>                 Key: BLUR-148
>                 URL:
>             Project: Apache Blur
>          Issue Type: Improvement
>          Components: Blur
>    Affects Versions: 0.2.0
>            Reporter: Aaron McCurry
>             Fix For: 0.2.0
> Need to call the warm index code on new segments after the NRT writer creates a new segment.
 Will also need to add a new state for the shardServerLayoutState call.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message