lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Trym R. Møller" <t...@sigmat.dk>
Subject Re: Facet search on a docvalue field in a multi shard collection
Date Mon, 23 Sep 2013 14:20:51 GMT
Hi

I have created https://issues.apache.org/jira/browse/SOLR-5260 as 
proposed by Erick.
I hope anyone working with doc values can lead me in a direction of how 
to solve the bug.

Best regards Trym

Den 23-09-2013 16:01, Erick Erickson skrev:
> I haven't dived into the code, but it sure looks like a JIRA to me,
> can you open one?
>
> Best,
> Erick
>
> On Mon, Sep 23, 2013 at 1:48 AM, "Trym R. Møller" <trym@sigmat.dk> wrote:
>> Hi Erick
>>
>> Thanks for your input.
>>
>> I have retrieved and build the branch
>> http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_5
>> Doing the same setup as in my previous post (two shard collection, fieldA af
>> docValue type, index a single document and doing a facet search on fieldA),
>> I now get the below exception. The cause (which is not visible from the
>> stacktrace) is as previous: "Cannot use facet.mincount=0 on field fieldA
>> which is not indexed"
>>
>> What could be my next steps from here?
>>
>> 620710 [qtp1728933440-15] ERROR org.apache.solr.core.SolrCore ▒
>> org.apache.solr.common.SolrException: Exception during facet.field: fieldA.
>> at org.apache.solr.request.SimpleFacets$2.call(SimpleFacets.java:569)
>> at org.apache.solr.request.SimpleFacets$2.call(SimpleFacets.java:554)
>> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>> at org.apache.solr.request.SimpleFacets$1.execute(SimpleFacets.java:508)
>> at
>> org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:579)
>> at
>> org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:265)
>>
>> at
>> org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:78)
>> at
>> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:208)
>> at
>> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
>> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1859)
>> at
>> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:703)
>> at
>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:406)
>> at
>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:195)
>>
>> at
>> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
>> at
>> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
>> at
>> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
>> at
>> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)
>> at
>> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
>> at
>> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)
>> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
>> at
>> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
>> at
>> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
>> at
>> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
>> at
>> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
>> at
>> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
>> at
>> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
>> at org.eclipse.jetty.server.Server.handle(Server.java:368)
>> at
>> org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
>> at
>> org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
>> at
>> org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
>> at
>> org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
>> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
>> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
>>
>> at
>> org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
>> at
>> org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
>> at
>> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>> at
>> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>> at java.lang.Thread.run(Thread.java:724)
>>
>> Den 22-09-2013 17:09, Erick Erickson skrev:
>>
>>> right, I think you're running into a bug I remember going by. I can't
>>> find it now, JIRA seems to be not responding. As I remember,
>>> where if a shard doesn't have a doc on it, you get an error.
>>>
>>> Although why facet.limit should figure in here is a mystery to me,
>>> maybe a coincidence?
>>>
>>> Significant work has been done about not requiring values for
>>> DocValues fields and stuff. Can you give a try on 4.x or the
>>> soon-to-be-released 4.5?
>>>
>>> Best,
>>> Erick
>>>
>>> On Sun, Sep 22, 2013 at 6:26 AM, "Trym R. Møller" <trym@sigmat.dk> wrote:
>>>> Hi
>>>>
>>>> I have a problem doing facet search on a doc value field in a multi shard
>>>> collection. Any ideas what I may be doing wrong?
>>>>
>>>> My Solr schema specifies fieldA as a docvalue type and I have created a
>>>> two
>>>> shard collection using Solr 4.4.0.
>>>> When I do a facet search on fieldA with a "large" facet.limit then the
>>>> query
>>>> fails with the below exception
>>>> A "large" facet.limit seems to be when (10 + (facet.limit * 1,5)) *
>>>> number
>>>> of shards > rows matching my query
>>>>
>>>> The exception does not occur when I run with a single shard collection.
>>>> It can easily be reproduced by indexing a single row and querying it, as
>>>> the
>>>> default facet.limit is 100.
>>>>
>>>> The facet query received by Solr looks as follows:
>>>>       576793 [qtp170860084-18] INFO  org.apache.solr.core.SolrCore  ¦
>>>> [trym_shard2_replica1] webapp=/solr path=/select
>>>>
>>>> params={facet=true&start=0&q=*:*&distrib=true&collection=trym&facet.field=fieldA&wt=javabin&version=2&rows=0}
>>>> status=500 QTime=20
>>>> One of the "internal query" send by Solr to its shard looks like
>>>>       576783 [qtp170860084-19] INFO  org.apache.solr.core.SolrCore  ¦
>>>> [trym_shard1_replica1] webapp=/solr path=/select
>>>> params={facet=true&distrib=false&collection=trym
>>>>
>>>>
>>>> &wt=javabin&version=2&rows=0&NOW=1379855011787&shard.url=192.168.56.1:8501/solr/trym_shard1_replica1/&df=text&fl=id,score&f.fieldA.facet.limit=160&start=0&q=*:
>>>>       *&facet.field=fieldA&isShard=true&fsv=true} hits=1 status=500
>>>> QTime=2
>>>>
>>>> 576784 [qtp170860084-17] ERROR org.apache.solr.servlet.SolrDispatchFilter
>>>> ¦
>>>> null:java.lang.IllegalStateException: Cannot use facet.mincount=0 on a
>>>> field
>>>> which is not indexed
>>>>           at
>>>> org.apache.solr.request.NumericFacets.getCounts(NumericFacets.java:257)
>>>>           at
>>>> org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:423)
>>>>           at
>>>>
>>>> org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:530)
>>>>           at
>>>>
>>>> org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:259)
>>>>           at
>>>>
>>>> org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:78)
>>>>           at
>>>>
>>>> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:208)
>>>>           at
>>>>
>>>> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
>>>>           at org.apache.solr.core.SolrCore.execute(SolrCore.java:1904)
>>>>           at
>>>>
>>>> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:659)
>>>>           at
>>>>
>>>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:362)
>>>>           at
>>>>
>>>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
>>>>           at
>>>>
>>>> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
>>>>           at
>>>>
>>>> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
>>>>           at
>>>>
>>>> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
>>>>           at
>>>>
>>>> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)
>>>>           at
>>>>
>>>> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
>>>>           at
>>>>
>>>> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)
>>>>           at
>>>> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
>>>>           at
>>>>
>>>> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
>>>>           at
>>>>
>>>> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
>>>>           at
>>>>
>>>> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
>>>>           at
>>>>
>>>> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
>>>>           at
>>>>
>>>> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
>>>>           at
>>>>
>>>> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
>>>>           at org.eclipse.jetty.server.Server.handle(Server.java:368)
>>>>           at
>>>>
>>>> org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
>>>>           at
>>>>
>>>> org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
>>>>           at
>>>>
>>>> org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
>>>>           at
>>>>
>>>> org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
>>>>           at
>>>> org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
>>>>           at
>>>> org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
>>>>           at
>>>>
>>>> org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
>>>>           at
>>>>
>>>> org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
>>>>           at
>>>>
>>>> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>>>>           at
>>>>
>>>> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>>>>           at java.lang.Thread.run(Thread.java:724)
>>>>
>>>>
>>>> My schema.xml contains the following lines (among others :-))
>>>>       <dynamicField name="*A" type="dlong" indexed="false" stored="true"
>>>> docValues="true" required="true"/>
>>>>       ...
>>>>       <fieldType name="dlong" class="solr.TrieLongField"
>>>> docValuesFormat="Disk" precisionStep="0" positionIncrementGap="0"/>
>>>>
>>>> Any help is appreciated. Thanks in advance.
>>>>
>>>> Best regards Trym
>>


Mime
View raw message