lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Rutherglen (JIRA)" <j...@apache.org>
Subject [jira] Commented: (LUCENE-1574) PooledSegmentReader, pools SegmentReader underlying byte arrays
Date Fri, 21 Jan 2011 23:24:44 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12984996#action_12984996
] 

Jason Rutherglen commented on LUCENE-1574:
------------------------------------------

I'm going to revive this, and if it works fine for trunk, then we can use the basic system
for RT eg, LUCENE-2312.  I think the only open question is how we'll shrink the pool, most
likely there'd be an expiration on the pooled objects.  With RT, the parallel arrays will
grow, so the pool will need to be size based, eg, when the arrays are grown, all of the previous
arrays may be forcefully evicted, or they may simply expire.



> PooledSegmentReader, pools SegmentReader underlying byte arrays
> ---------------------------------------------------------------
>
>                 Key: LUCENE-1574
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1574
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: contrib/*
>    Affects Versions: 2.4.1
>            Reporter: Jason Rutherglen
>            Priority: Minor
>             Fix For: 4.0
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> PooledSegmentReader pools the underlying byte arrays of deleted docs and norms for realtime
search.  It is designed for use with IndexReader.clone which can create many copies of byte
arrays, which are of the same length for a given segment.  When pooled they can be reused
which could save on memory.  
> Do we want to benchmark the memory usage comparison of PooledSegmentReader vs GC?  Many
times GC is enough for these smaller objects.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message