lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dominique Bejean <dominique.bej...@eolya.fr>
Subject Re: JVM GC Issue
Date Sat, 02 Dec 2017 16:01:21 GMT
Hi Toke,

Nearly 30% of the requests are setting facet.limit=200

On 42000 requests the number of time each field is used for faceting is

$ grep  'facet=true' select.log | grep -oP 'facet.field=([^&])*' | sort |
uniq -c | sort -r

 23119 facet.field=category_path

  8643 facet.field=EUR_0_price_decimal

  5560 facet.field=type_pratique_facet

  5560 facet.field=size_facet_facet

  5560 facet.field=marque_facet

  5560 facet.field=is_marketplace_origin_facet

  5560 facet.field=gender_facet

  5560 facet.field=color_facet_facet

  5560 facet.field=club_facet

  5560 facet.field=age_facet

  3290 facet.field=durete_facet

  3290 facet.field=diametre_roues_facet

   169 facet.field=EUR_1_price_decimal

    38 facet.field=EUR_4_price_decimal


The larger count of unique values for these fields are

category_path 3025

marque_facet 2100

size_facet_facet 1400

type_pratique_facet 166

color_facet_facet 165

Here are 2 typical queries :

2017-11-20 10:13:27.585 INFO  (qtp592179046-15153) [   x:french]
o.a.s.c.S.Request [french]  webapp=/solr path=/select
params={mm=100%25&facet.field=category_path&facet.field=age_facet&facet.field=is_marketplace_origin_facet&facet.field=type_pratique_facet&facet.field=gender_facet&facet.field=color_facet_facet&facet.field=size_facet_facet&facet.field=EUR_0_price_decimal&facet.field=EUR_0_price_decimal&facet.field=marque_facet&facet.field=club_facet&facet.field=diametre_roues_facet&facet.field=durete_facet&q.alt=*:*&
json.nl=map&fl=products_id,product_type_static,name_varchar,store_id,website_id,EUR_0_price_decimal&start=0&fq=(store_id:"1")+AND+(website_id:"1")+AND+(product_status:"1")+AND+(category_id:"3389")+AND+(filter_visibility_int:"2"+OR+filter_visibility_int:"4")&rows=48&bq=is_marketplace_origin_boost_exact:"OUI"^210+is_marketplace_origin_boost:OUI^207+is_marketplace_origin_relative_boost:OUI^203+is_marketplace_origin_boost_exact:"NON"^210+is_marketplace_origin_boost:NON^207+is_marketplace_origin_relative_boost:NON^203+&q=*:*&facet.limit=200&spellcheck.q=&defType=edismax&qf=textSearch&stats=true&facet.mincount=1&facet=true&wt=json&stats.field=EUR_0_price_decimal&stats.field=sort_EUR_0_special_price_decimal&spellcheck.collate=true&timestamp=1511172807}
hits=953 status=0 QTime=26

2017-11-20 10:17:28.193 INFO  (qtp592179046-17115) [   x:french]
o.a.s.c.S.Request [french]  webapp=/solr path=/select
params={mm=100%25&facet.field=category_path&facet.field=age_facet&facet.field=is_marketplace_origin_facet&facet.field=type_pratique_facet&facet.field=gender_facet&facet.field=color_facet_facet&facet.field=size_facet_facet&facet.field=EUR_0_price_decimal&facet.field=marque_facet&facet.field=club_facet&
json.nl=map&fl=products_id,product_type_static,name_varchar,store_id,website_id,EUR_0_price_decimal&start=0&fq=(store_id:"1")+AND+(website_id:"1")+AND+(product_status:"1")+AND+(filter_visibility_int:"3"+OR+filter_visibility_int:"4")8&bq=name_boost_exact:"velo"^120+name_boost:"velo"^100+name_relative_boost:velo^80+category_boost:velo^60+is_marketplace_origin_boost_exact:"OUI"^210+is_marketplace_origin_boost:OUI^207+is_marketplace_origin_relative_boost:OUI^203+is_marketplace_origin_boost_exact:"NON"^210+is_marketplace_origin_boost:NON^207+is_marketplace_origin_relative_boost:NON^203+size_facet_boost_exact:"velo"^299+size_facet_boost:velo^296+size_facet_relative_boost:velo^292+marque_boost_exact:"velo"^359+marque_boost:velo^356+marque_relative_boost:velo^352+&q=velo&facet.limit=200&spellcheck.q=velo&defType=edismax&qf=textSearch&stats=true&facet.mincount=1&facet=true&wt=json&stats.field=EUR_0_price_decimal&stats.field=sort_EUR_0_special_price_decimal&spellcheck.collate=true&timestamp=1511173047}
hits=6761 status=0 QTime=38




Dominique


Le sam. 2 déc. 2017 à 16:23, Toke Eskildsen <toes@kb.dk> a écrit :

> Dominique Bejean <dominique.bejean@eolya.fr> wrote:
> > Hi, Thank you for the explanations about faceting. I was thinking the hit
> > count had a biggest impact on facet memory lifecycle.
>
> Only if you have a very high facet.limit. Could you provide us with a
> typical query, including all the parameters?
>
> - Toke Eskildsen
>
-- 
Dominique Béjean
06 08 46 12 43

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message