Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
From: =?utf-8?Q?Emir_Arnautovi=C4=87?= <emir.arnautovic@sematext.com>
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\))
Subject: Re: Faceting Word Count
Date: Mon, 6 Nov 2017 11:29:05 +0100
References: <CACCK0pxTCB6zt0xET53_uqKe1kr3W9iKhwrJ-6MuB_SYjVgxwQ@mail.gmail.com>
To: solr-user@lucene.apache.org
In-Reply-To: <CACCK0pxTCB6zt0xET53_uqKe1kr3W9iKhwrJ-6MuB_SYjVgxwQ@mail.gmail.com>
Message-Id: <3709F6D2-6A01-4180-A78A-473D0E37F7EE@sematext.com>
archived-at: Mon, 06 Nov 2017 10:29:13 -0000

Hi Wael,
Can you provide your field definition and sample query.

Thanks,
Emir
--
Monitoring - Log Management - Alerting - Anomaly Detection
Solr & Elasticsearch Consulting Support Training - http://sematext.com/


> On 6 Nov 2017, at 08:30, Wael Kader <wael@softech-lb.com> wrote:
> 
> Hello,
> 
> I am having an index with around 100 Million documents.
> I have a multivalued column that I am saving big chunks of text data in. It
> has around 20 GB of RAM and 4 CPU's.
> 
> I was doing faceting on it to get word cloud but it was taking around 1
> second to retrieve when the data was 5-10 Million .
> Now I have more data and its taking minutes to get the results (that is if
> it gets it and SOLR doesn't crash). Whats the best way to make it run or
> maybe its not scalable to make it run on my current schema and design with
> News articles.
> 
> I am looking to find the best solution for this. Maybe create another index
> to split the data while inserting it or maybe if I change some settings in
> SolrConfig or add some RAM, it would perform better.
> 
> -- 
> Regards,
> Wael