lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yonik Seeley (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (SOLR-9592) decorateDocValues cause serious performance issue because of using slowCompositeReaderWrapper
Date Wed, 05 Oct 2016 16:11:20 GMT

     [ https://issues.apache.org/jira/browse/SOLR-9592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Yonik Seeley reassigned SOLR-9592:
----------------------------------

    Assignee: Yonik Seeley

> decorateDocValues cause serious performance issue because of using slowCompositeReaderWrapper
> ---------------------------------------------------------------------------------------------
>
>                 Key: SOLR-9592
>                 URL: https://issues.apache.org/jira/browse/SOLR-9592
>             Project: Solr
>          Issue Type: Improvement
>      Security Level: Public(Default Security Level. Issues are Public) 
>          Components: Response Writers, search
>    Affects Versions: 6.0, 6.1, 6.2
>            Reporter: Takahiro Ishikawa
>            Assignee: Yonik Seeley
>              Labels: performance
>             Fix For: 6.3, master (7.0)
>
>         Attachments: SOLR-9592.patch, SOLR-9592.patch, SOLR-9592_6x.patch
>
>
> I have serious performance issue using AtomicUpdate (and RealtimeGet) with non stored
docValues.
> Because decorateDocValues try to merge each leafLeader on the fly via slowCompositeReaderWrapper
and it’s extremely slow (> 10sec).
> Simply access docValues via nonCompositeReader could resolve this issue.(patch) 
> AtomicUpdate performance(or RealtimeGet performance)
> * Environment
> ** solr version : 6.0.0
> ** schema ~ 100 fields(90% docValues, some of those are multi valued)
> ** index : 5,000,000
> * Performance
> ** original :  > 10sec per query
> ** patched : at least 100msec per query
> This patch will also enhance search performance, because DocStreamer also fetch docValues
via decorateDocValues.
> Though it depends on each environment, I could take 20% search performance gain.
> (This patch originally written for solr 6.0.0, and now rewritten for master)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message