Return-Path: 
 <solr-user-return-91111-apmail-lucene-solr-user-archive=lucene.apache.org@lucene.apache.org>
X-Original-To: apmail-lucene-solr-user-archive@minotaur.apache.org
Delivered-To: apmail-lucene-solr-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 7C2AC10F6B
	for <apmail-lucene-solr-user-archive@minotaur.apache.org>;
 Mon, 16 Sep 2013 05:44:39 +0000 (UTC)
Received: (qmail 74163 invoked by uid 500); 16 Sep 2013 05:44:31 -0000
Delivered-To: apmail-lucene-solr-user-archive@lucene.apache.org
Received: (qmail 73707 invoked by uid 500); 16 Sep 2013 05:44:22 -0000
Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:solr-user-help@lucene.apache.org>
List-Unsubscribe: <mailto:solr-user-unsubscribe@lucene.apache.org>
List-Post: <mailto:solr-user@lucene.apache.org>
List-Id: <solr-user.lucene.apache.org>
Reply-To: solr-user@lucene.apache.org
Delivered-To: mailing list solr-user@lucene.apache.org
Received: (qmail 73698 invoked by uid 99); 16 Sep 2013 05:44:20 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 16 Sep 2013 05:44:20 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of rohit.kkumar@gmail.com
 designates 209.85.128.174 as permitted sender)
Received: from [209.85.128.174] (HELO mail-ve0-f174.google.com)
 (209.85.128.174)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 16 Sep 2013 05:44:15 +0000
Received: by mail-ve0-f174.google.com with SMTP id jy13so2644342veb.33
        for <solr-user@lucene.apache.org>;
 Sun, 15 Sep 2013 22:43:54 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:date:message-id:subject:from:to:content-type;
        bh=Exu1judHQmZ1kGvTnbXyIYoRA3VvKyB7X3ew0ToPdmI=;
        b=K/KsEy85n3whNl6lDvYwnvdSoSuZ7/i24yPauIlacJh/GYyHGOd38EiyL18/M/l9yg
         em9HTz6kMMo/8BJh901/ILGrE2/bTMmnrz6zUugUX/s+0IYqJM4O8BXMa7L7qRgUJaxA
         UT6gbVhMFmB7Kzm8CWP2OY3RpCl+L+bD7xU9ieJY+nQoA4Mszb3ZxL7mBd1jKYRIulqc
         UPWg2he7H5AmG+1FaCPUGPDzv3Nu/MRNiBqEhxlq92j5KDWmPFvNJYQK/MJGjAdASpKD
         UQNbWBTQwqHBArR1El47L8EpO42NG3sGhVTRGB1rV+tdDNaLUnvcDqdbXQgWU0bdLcI9
         Tryw==
MIME-Version: 1.0
X-Received: by 10.58.137.167 with SMTP id qj7mr24979053veb.1.1379310234705;
 Sun, 15 Sep 2013 22:43:54 -0700 (PDT)
Received: by 10.221.63.68 with HTTP; Sun, 15 Sep 2013 22:43:54 -0700 (PDT)
Date: Mon, 16 Sep 2013 11:13:54 +0530
Message-ID: 
 <CADBQLMKDid1dbJie06dmow7Uu6rMkmF_pN_HMQE7BfMY-GYC0g@mail.gmail.com>
Subject: Frequent softCommits leading to high faceting times?
From: Rohit Kumar <rohit.kkumar@gmail.com>
To: solr-user@lucene.apache.org
Content-Type: multipart/alternative; boundary=047d7b677efa93271c04e679b014
X-Virus-Checked: Checked by ClamAV on apache.org

--047d7b677efa93271c04e679b014
Content-Type: text/plain; charset=ISO-8859-1

Hi,

We are running *SOLR 4.3* with 8 Gb of index on

Ubuntu 12.04 64 bits
Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz Single core.
16GB RAM


We just started using the autoSoftCommit feature and noticed the facet
queries slowed down from milliseconds taking earlier to a minute. We have *8
facet fields*.

We add close to 300 documents per second during peak interval.

<autoCommit>
    <maxTime>600000</maxTime>
    <openSearcher>false</openSearcher>
</autoCommit>

<autoSoftCommit>
    <maxTime>1000</maxTime>
</autoSoftCommit>


Here is some information i got with debugQuery. Please note that *facet
time is more than 50 seconds.*

<lst name="process">
    <double name="time">50779.0</double>
    <lst name="network">
        <double name="time">0.0</double>
    </lst>
    <lst name="query">
        <double name="time">41.0</double>
    </lst>
    *<lst name="facet">
        <double name="time">50590.0</double>
    </lst>*
    <lst name="mlt">
        <double name="time">0.0</double>
    </lst>
    <lst name="highlight">
        <double name="time">0.0</double>
    </lst>
    <lst name="stats">
        <double name="time">0.0</double>
    </lst>
    <lst name="connection">
        <double name="time">5.0</double>
    </lst>
    <lst name="debug">
        <double name="time">143.0</double>
    </lst>
</lst>

Please help.

Thanks,
Rohit Kumar

--047d7b677efa93271c04e679b014--