lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Simon Willnauer (Commented) (JIRA)" <>
Subject [jira] [Commented] (LUCENE-2949) FastVectorHighlighter FieldTermStack could likely benefit from using TermVectorMapper
Date Sat, 12 Nov 2011 02:18:51 GMT


Simon Willnauer commented on LUCENE-2949:

Koji, I wonder if we can make use of:
public abstract void setExpectations(String field, int numTerms, boolean storeOffsets, boolean

we could actually allocate an array for TermInfo instead of a LinkedList which creates tons
of object. I'd even go further and say we allocate a parallel array ie. one array for start
& end offset, position, term (ByteBlockPool maybe even?) this would reduce the num of
objects dramatically.

> FastVectorHighlighter FieldTermStack could likely benefit from using TermVectorMapper
> -------------------------------------------------------------------------------------
>                 Key: LUCENE-2949
>                 URL:
>             Project: Lucene - Java
>          Issue Type: Improvement
>    Affects Versions: 3.0.3, 4.0
>            Reporter: Grant Ingersoll
>            Assignee: Koji Sekiguchi
>            Priority: Minor
>              Labels: FastVectorHighlighter, Highlighter
>             Fix For: 3.5, 4.0
>         Attachments: LUCENE-2949.patch
> Based on my reading of the FieldTermStack constructor that loads the vector from disk,
we could probably save a bunch of time and memory by using the TermVectorMapper callback mechanism
instead of materializing the full array of terms into memory and then throwing most of them

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message