lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SOLR-7730) speed-up faceting on doc values fields
Date Tue, 15 Dec 2015 20:32:46 GMT

    [ https://issues.apache.org/jira/browse/SOLR-7730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058739#comment-15058739
] 

ASF subversion and git services commented on SOLR-7730:
-------------------------------------------------------

Commit 1720239 from mkhl@apache.org in branch 'dev/trunk'
[ https://svn.apache.org/r1720239 ]

SOLR-7730: mention in 5.4.0's Optimizations

> speed-up faceting on doc values fields
> --------------------------------------
>
>                 Key: SOLR-7730
>                 URL: https://issues.apache.org/jira/browse/SOLR-7730
>             Project: Solr
>          Issue Type: Improvement
>          Components: faceting
>    Affects Versions: 5.2.1
>            Reporter: Mikhail Khludnev
>            Assignee: Mikhail Khludnev
>              Labels: patch
>             Fix For: 5.4
>
>         Attachments: LUCENE-7730.patch, LUCENE-7730.patch, SOLR-7730-changes.patch, SOLR-7730.patch
>
>
> every time we count facets on DocValues fields in Solr on many segments index we see
the unnecessary hotspot:
> {code}
> ....
>         at org.apache.lucene.index.MultiFields.getMergedFieldInfos(MultiFields.java:248)
>         at org.apache.lucene.index.SlowCompositeReaderWrapper.getFieldInfos(SlowCompositeReaderWrapper.java:239)
>         at org.apache.lucene.index.SlowCompositeReaderWrapper.getSortedSetDocValues(SlowCompositeReaderWrapper.java:176)
>         at org.apache.solr.request.DocValuesFacets.getCounts(DocValuesFacets.java:72)
>         at org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:460)
....
> {code}
> the reason is SlowCompositeReaderWrapper.getSortedSetDocValues() Line 136 and SlowCompositeReaderWrapper.getSortedDocValues()
Line 174
> before return composite doc values, SCWR merges segment field infos, which is expensive,
but after fieldinfo is merged, it checks *only* docvalue type in it. This dv type check can
be done much easier in per segment basis. 
> This patch gets some performance gain for those who count DV facets in Solr.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message