lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Georg Fette <georg.fe...@uni-wuerzburg.de>
Subject Re: Solr Server crashes when requesting a result with too large resultRows
Date Tue, 31 Jul 2018 16:33:25 GMT
Hi Christoph,
Yes ist is only one of the processors that is at maximum capacity.
How do I do something like a thread-dump of a single thread ? We run the
Solr from the command line out-of-the-box and not in a code development
environment. Are there parameters that can be configured so that the
server creates dumps ?
Greetings
Georg

Am 31.07.2018 um 15:07 schrieb Christopher Schultz:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA256
>
> Georg,
>
> On 7/31/18 4:39 AM, Georg Fette wrote:
>> We run the server version 7.3.1. on a machine with 32GB RAM in a
>> mode having -10g.
>>
>> When requesting a query with
>>
>> q={!boost
>> b=sv_int_catalog_count_document}string_catalog_aliases:(*2*)&fq=string
> _field_type:catalog_entry&rows=2147483647
>>
>>
>> the server takes all available memory up to 10GB and is then no
>> longer accessible with one processor at 100%.
> Is it a single thread which takes the CPU or more than one? Can you
> identify that thread and take a thread dump to get a backtrace for
> that thread?
>
>> When we reduce the rows parameter to 10000000 the query works. The
>> query returns only 581 results.
>>
>> The documentation at
>> https://wiki.apache.org/solr/CommonQueryParameters states that as
>> the "rows" parameter a "ridiculously large value" may be used, but
>> this could pose a problem. The number we used was Int.max from
>> Java.
> Interesting. I wonder if Solr attempts to pre-allocate a result
> buffer. Requesting 2147483647 rows can have an adverse affect on most
> pre-allocated data structures.
>
> - -chris
> -----BEGIN PGP SIGNATURE-----
> Comment: GPGTools - http://gpgtools.org
> Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
>
> iQIzBAEBCAAdFiEEMmKgYcQvxMe7tcJcHPApP6U8pFgFAltgXy4ACgkQHPApP6U8
> pFicOQ//c1Qe0hLOHIbSvmxAMVEhqZTjQlzEGFoYYhC1aGrYpw++RKQYtBLD2kmN
> DcLLkwFOmwv5CDft+Mn+g5ZWhEuZSKnwFgxsPfTAbRGjDYGQ7qCzzGq2JGacoxTJ
> rPgizyRlZQ4f5QY0RHohAGFx/QhgPtLdSl0V32eERWH8fVJWvDH3iYTTTSDN4UCY
> /bpB34nrruBgh2iTz9UcGR1jnTw9iU57OVYRwtTk8ETeOivcBM5MTXzKbwQ8/w5m
> c7lmKWqMG0G5XKKu6KDbWFZwSwYLBvHTUQurqgS2pkm+r2c4xP5/U0+uI5D9EseS
> 1HiOjWBuhWFEIveioKCOQbPAWL+C0i4xMbBLiC4RZPnTs6LSQ0aXm4Jx05NFoAWt
> 3HA2VCb9rrK5y8cICSCbVGaPNNBT9HHqJqeo2eGbzLaZXP5iRCc8BdkjHTPrSqCq
> gh8FEAK9pVS3ejO96DZvIoiIEpcmRNuSHczdE7YKwCv5XvytSh4QXa0SKluEhpYo
> acPXOtjIbqFcTZ1f+hZTfiG1/PeCUnYshta8VdSyvIjm748wOB7wqs7uYhl0b6zx
> i6OgoQ3bOel8e7oAO4Fmv5LE56b8A4tOPzPBf4Y1ehb8e8HbBdSzZuzqZZrQqChQ
> AUfrEzaXUKIBsmlaUneT2qjsLLZZmU+Gk0EYJnmHw63RQR/QxKg=
> =IXGx
> -----END PGP SIGNATURE-----
>

-- 
---------------------------------------------------------------------
Dipl.-Inf. Georg Fette      Raum: B009
Universität Würzburg        Tel.: +49-(0)931-31-85516
Am Hubland                  Fax.: +49-(0)931-31-86732
97074 Würzburg              mail: georg.fette@uni-wuerzburg.de
---------------------------------------------------------------------


Mime
View raw message