Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
MIME-Version: 1.0
In-Reply-To: <56015962.8060503@hebis.uni-frankfurt.de>
References: <55FFF384.1030301@hebis.uni-frankfurt.de>
	<CAOOKt529SpHAsuqhba+rYBX4W8uzfhRzPzzXD_B1z8pKFqDeqA@mail.gmail.com>
	<56000953.8020201@hebis.uni-frankfurt.de>
	<CAE4tqLPcTdFZw=U9htrvrRsx2AZyu65RDv010t81SeCiU8vwDQ@mail.gmail.com>
	<56012ECD.5020406@hebis.uni-frankfurt.de>
	<CANGii8ecQvfdTFSjWPp6-75YBVfRMhNhx4ph2wzasL2tpeBXUA@mail.gmail.com>
	<56015962.8060503@hebis.uni-frankfurt.de>
Date: Tue, 22 Sep 2015 11:50:27 -0400
Message-ID: 
 <CAE4tqLMunMoLk=YYT_v2uGpbgLhut4+aKKh7_AGxLPuWaqMGAg@mail.gmail.com>
Subject: Re: faceting is unusable slow since upgrade to 5.3.0
From: Joel Bernstein <joelsolr@gmail.com>
To: solr-user@lucene.apache.org
Content-Type: multipart/alternative; boundary=001a1139936ef46ead052057f4f9

--001a1139936ef46ead052057f4f9
Content-Type: text/plain; charset=UTF-8

Can you also try testing with one facet at a time and see if we hit a
particular facet that is slow?

Joel Bernstein
http://joelsolr.blogspot.com/

On Tue, Sep 22, 2015 at 9:36 AM, Uwe Reh <reh@hebis.uni-frankfurt.de> wrote:

> The exact version as shown by the UI is:
> - solr-impl   5.3.0 1696229 - noble - 2015-08-17 17:10:43
> - lucene-impl 5.3.0 1696229 - noble - 2015-08-17 16:59:03
>
> Unfortunately my skills in debugging are limited. So I'm not sure about a
> 'deeper caller stack'.
> Did you mean the attached snapshot from VirtualVM, a stack trace like
> below or something else? Please give me a hint.
>
> uwe
>
> "qtp1734853116-68" #68 prio=5 os_prio=64 tid=0x00000000117fd800 nid=0x77
>> runnable [0xfffffd7f991fc000]
>>    java.lang.Thread.State: RUNNABLE
>>         at java.util.HashMap.resize(HashMap.java:734)
>>         at java.util.HashMap.putVal(HashMap.java:662)
>>         at java.util.HashMap.put(HashMap.java:611)
>>         at
>> org.apache.lucene.index.FieldInfos$Builder.addOrUpdateInternal(FieldInfos.java:344)
>>         at
>> org.apache.lucene.index.FieldInfos$Builder.add(FieldInfos.java:366)
>>         at
>> org.apache.lucene.index.FieldInfos$Builder.add(FieldInfos.java:304)
>>         at
>> org.apache.lucene.index.MultiFields.getMergedFieldInfos(MultiFields.java:245)
>>         at
>> org.apache.lucene.index.SlowCompositeReaderWrapper.getFieldInfos(SlowCompositeReaderWrapper.java:237)
>>         at
>> org.apache.lucene.index.SlowCompositeReaderWrapper.getSortedSetDocValues(SlowCompositeReaderWrapper.java:174)
>>         at
>> org.apache.solr.request.DocValuesFacets.getCounts(DocValuesFacets.java:72)
>>         at
>> org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:492)
>>         at
>> org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:385)
>>         at
>> org.apache.solr.request.SimpleFacets$3.call(SimpleFacets.java:628)
>>         at
>> org.apache.solr.request.SimpleFacets$3.call(SimpleFacets.java:619)
>>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>         at
>> org.apache.solr.request.SimpleFacets$2.execute(SimpleFacets.java:573)
>>         at
>> org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:644)
>>         at
>> org.apache.solr.handler.component.FacetComponent.getFacetCounts(FacetComponent.java:294)
>>         at
>> org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:256)
>>         at
>> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:285)
>>         at
>> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143)
>>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:2068)
>>         at
>> org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:669)
>>         at
>> org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:462)
>>         at
>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:210)
>>         at
>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:179)
>>         at
>> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
>>         at
>> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
>>         at
>> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
>>         at
>> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:577)
>>         at
>> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
>>         at
>> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
>>         at
>> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
>>         at
>> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
>>         at
>> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
>>         at
>> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
>>         at
>> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
>>         at
>> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110)
>>         at
>> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
>>         at org.eclipse.jetty.server.Server.handle(Server.java:499)
>>         at
>> org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
>>         at
>> org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
>>         at org.eclipse.jetty.io
>> .AbstractConnection$2.run(AbstractConnection.java:540)
>>         at
>> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
>>         at
>> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
>>         at java.lang.Thread.run(Thread.java:745)
>>
>
>
>
> Am 22.09.2015 um 12:56 schrieb Mikhail Khludnev:
>
>> It's quite strange
>> https://issues.apache.org/jira/browse/SOLR-7730 significantly optimized
>> DV
>> facets at 5.3.0 exactly by avoiding FileInfo merge.
>> Would you mind to provide deeper caller stack for
>> org.apache.lucene.index.FileInfos.MultibleFields.getMergedFieldInfos()?
>> Or a time spend in SlowCompositeReaderWrapper, DocValuesFacets,
>> MultiDocValues and their hot methods.
>> Which version you exactly on? and how do you know that?
>> Thanks
>>
>>
>

--001a1139936ef46ead052057f4f9--