lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Salman Akram <salman.ak...@northbaysolutions.net>
Subject Re: SOLR 4 not utilizing multi CPU cores
Date Thu, 05 Dec 2013 09:23:46 GMT
So I think I found one issue that somewhat explains the time difference but
not sure why this is happening. We are using Surround Query Parser. Below
is a two words query, both of them are in Common Grams list.

Query = "only be"

Here is what debug shows. I have highlighted the red part which is
different in both versions i.e. SOLR 4.6 is making it a multiphrasequery. I
am going to look into Surround Query Parser but not sure if it's an issue
with it or something else.

*SOLR 4.6 (takes 20 secs)*
<str name="rawquerystring">{!surround}<Contents:"only be"></str>
<str name="querystring">{!surround}<Contents:"only be"></str>
<str name="parsedquery">MultiPhraseQuery(Contents:"(only only_be) be")</str>
<str name="parsedquery_toString">Contents:"(only only_be) be"</str>

*SOLR 1.4.1 (takes 1 sec)*
<str name="rawquerystring">{!surround}<Contents:"only be"></str>
<str name="querystring">{!surround}<Contents:"only be"></str>
<str name="parsedquery">Contents:only_be</str>
<str name="parsedquery_toString">Contents:only_be</str>


P.S: The other issue still remains there that why is it not utilizing
multiple cpu cores.


On Thu, Dec 5, 2013 at 2:11 PM, Salman Akram <
salman.akram@northbaysolutions.net> wrote:

> More info on Cpu consumption: We have a server with 32 physical cores.
>
> Same search when executed on SOLR 4.6 takes quite long and throughout only
> uses 3% cpu (1 core).
>
> Same search when executed on SOLR 1.4.1 takes much less time and on
> average uses around 40-50% cpu.
>
>
> On Thu, Dec 5, 2013 at 2:05 PM, Salman Akram <
> salman.akram@northbaysolutions.net> wrote:
>
>> I missed one imp piece of info. Due to large size we have indexed the
>> date with Common Grams. All of the words in slow search are in common grams
>> and when I debug it, they query is made properly with common grams.
>>
>> In debug all of the time is shown in process query time.
>>
>> Let me know what other info you need? Thanks
>>
>>
>> On Thu, Dec 5, 2013 at 11:38 AM, Andrea Gazzarini <agazzarini@apache.org>wrote:
>>
>>> Hi, I did moreless the same but didn't get that behaviour...could you
>>> give
>>> us more details
>>>
>>> Best,
>>> Gazza
>>> On 5 Dec 2013 06:54, "Salman Akram" <salman.akram@northbaysolutions.net>
>>> wrote:
>>>
>>> > Hi,
>>> >
>>> > We recently upgraded to SOLR 4.6 from SOLR 1.4.1. Overall the
>>> performance
>>> > went down for large phrase queries. On some analysis we have seen that
>>> > 1.4.1 utilized multiple cpu cores for such queries but SOLR 4.6 is only
>>> > utilizing single cpu core. Any idea on what could be the reason?
>>> >
>>> > Note: We are not using SOLR Sharding.
>>> >
>>> > --
>>> > Regards,
>>> >
>>> > Salman Akram
>>> >
>>>
>>
>>
>>
>> --
>> Regards,
>>
>> Salman Akram
>>
>>
>
>
> --
> Regards,
>
> Salman Akram
>
>


-- 
Regards,

Salman Akram

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message