Return-Path: X-Original-To: apmail-lucene-solr-user-archive@minotaur.apache.org Delivered-To: apmail-lucene-solr-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3A29717D50 for ; Wed, 18 Mar 2015 20:03:11 +0000 (UTC) Received: (qmail 98835 invoked by uid 500); 18 Mar 2015 20:03:07 -0000 Delivered-To: apmail-lucene-solr-user-archive@lucene.apache.org Received: (qmail 98765 invoked by uid 500); 18 Mar 2015 20:03:07 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 98753 invoked by uid 99); 18 Mar 2015 20:03:07 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Mar 2015 20:03:06 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of vaibhav.bhandari19@gmail.com designates 209.85.213.169 as permitted sender) Received: from [209.85.213.169] (HELO mail-ig0-f169.google.com) (209.85.213.169) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Mar 2015 20:02:41 +0000 Received: by igcqo1 with SMTP id qo1so55124519igc.0 for ; Wed, 18 Mar 2015 13:00:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type; bh=fsDd4EU+fUfB1l7HRUQIhz1q4cf9K3MOHxgZTtAqrEI=; b=uGN60s4VnCO1YU9d1uVqIc9h2ZGONfLF/bttS8NyQUAJNyryIPvLS+PDHFRQ7fS74/ W7HwxxY5UxlpXJ+WExsvttvN27CXL3/5aBS2ZDMmSwWiggxH3/v5blegJFQymdnMqQ8B 2YTkAuKyMT8RW0OeXEMR9nS9hlPyBaCShLF2cVW/KqCy8uXNg44IHD1BUIrsomC0wkBw kPdJlpYRC6P2MG0SOXGF3dBQcgufbpr7H9ZxSQZ4ksy5K+JcdloH2g+VQ7T+pqOT+Y6b dM/GqBInIDgjuIem0sHlec2Nzom9ESJdykTWYyefoniqiO3mYog8EfXjp/MbrMjeCSky 0wag== X-Received: by 10.43.110.136 with SMTP id ek8mr26257687icc.87.1426708824370; Wed, 18 Mar 2015 13:00:24 -0700 (PDT) MIME-Version: 1.0 Received: by 10.50.148.36 with HTTP; Wed, 18 Mar 2015 12:59:43 -0700 (PDT) From: Vaibhav Bhandari Date: Wed, 18 Mar 2015 12:59:43 -0700 Message-ID: Subject: High memory usage while querying with sort using cursor To: solr-user@lucene.apache.org Content-Type: multipart/alternative; boundary=bcaec5171ab1acb5120511958878 X-Virus-Checked: Checked by ClamAV on apache.org --bcaec5171ab1acb5120511958878 Content-Type: text/plain; charset=UTF-8 Hi all, My setup is as follows: *Collection* size: 32GB, 2 shards, replication factor: 2 (~16GB on each replica). Number of rows: 250million 4 *Solr* nodes: RAM: 30GB each. Heap size: 8GB. Version: 4.9.1 Besides the collection in question, the nodes have some other collections present. The total size of all collections of each node is 30GB (which is the same as the amount of RAM on them). A simple query on the collection: ../select?q=*:* works perfectly fine. But as soon as i add sorting, it crashes the nodes with OOM: .../select?q=*:*&sort=unique_id asc&rows=0. I have tried to disable filter-cache and query-result-cache. But that did not help either. Any ideas/suggestions? Thanks, Vaibhav --bcaec5171ab1acb5120511958878--