Return-Path: 
 <solr-user-return-47898-apmail-lucene-solr-user-archive=lucene.apache.org@lucene.apache.org>
Delivered-To: apmail-lucene-solr-user-archive@minotaur.apache.org
Received: (qmail 40277 invoked from network); 22 Feb 2011 19:45:06 -0000
Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3)
  by minotaur.apache.org with SMTP; 22 Feb 2011 19:45:06 -0000
Received: (qmail 70322 invoked by uid 500); 22 Feb 2011 19:45:03 -0000
Delivered-To: apmail-lucene-solr-user-archive@lucene.apache.org
Received: (qmail 70237 invoked by uid 500); 22 Feb 2011 19:45:03 -0000
Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:solr-user-help@lucene.apache.org>
List-Unsubscribe: <mailto:solr-user-unsubscribe@lucene.apache.org>
List-Post: <mailto:solr-user@lucene.apache.org>
List-Id: <solr-user.lucene.apache.org>
Reply-To: solr-user@lucene.apache.org
Delivered-To: mailing list solr-user@lucene.apache.org
Received: (qmail 70224 invoked by uid 99); 22 Feb 2011 19:45:02 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Feb 2011 19:45:02 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
	tests=SPF_HELO_PASS,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of gcjsu-solr-user@m.gmane.org
 designates 80.91.229.12 as permitted sender)
Received: from [80.91.229.12] (HELO lo.gmane.org) (80.91.229.12)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Feb 2011 19:44:53 +0000
Received: from list by lo.gmane.org with local (Exim 4.69)
	(envelope-from <gcjsu-solr-user@m.gmane.org>)
	id 1Pry9t-000778-M6
	for solr-user@lucene.apache.org; Tue, 22 Feb 2011 20:44:30 +0100
Received: from c-71-202-120-204.hsd1.ca.comcast.net ([71.202.120.204])
        by main.gmane.org with esmtp (Gmexim 0.1 (Debian))
        id 1AlnuQ-0007hv-00
        for <solr-user@lucene.apache.org>; Tue, 22 Feb 2011 20:44:29 +0100
Received: from jsd by c-71-202-120-204.hsd1.ca.comcast.net with local (Gmexim
 0.1 (Debian))
        id 1AlnuQ-0007hv-00
        for <solr-user@lucene.apache.org>; Tue, 22 Feb 2011 20:44:29 +0100
X-Injected-Via-Gmane: http://gmane.org/
To: solr-user@lucene.apache.org
From: Jon Drukman <jsd@cluttered.com>
Subject: Sorting - bad performance
Date: Tue, 22 Feb 2011 19:44:19 +0000 (UTC)
Lines: 33
Message-ID: <loom.20110222T203901-738@post.gmane.org>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
X-Complaints-To: usenet@dough.gmane.org
X-Gmane-NNTP-Posting-Host: sea.gmane.org
User-Agent: Loom/3.14 (http://gmane.org/)
X-Loom-IP: 71.202.120.204 (Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6;
 en-US; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13)
X-Virus-Checked: Checked by ClamAV on apache.org

The performance factors wiki says:
"If you do a lot of field based sorting, it is advantageous to add explicitly
warming queries to the "newSearcher" and "firstSearcher" event listeners in your
solrconfig which sort on those fields, so the FieldCache is populated prior to
any queries being executed by your users."

I've got an index with 24+ million docs of forum posts from users.  I want to be
able to get a given user's posts sorted by date.  It's taking 20 seconds right
now.  What would I put in the newSearch/firstSearcher to make that quicker?  Is
there any other general approach I can use to speed up sorting?

The schema looks like

 <fields>
   <field name="type_id" type="string" indexed="true" stored="true"
required="true" />
   <field name="subhead" type="text" indexed="true" stored="true"/>
   <field name="post_date" type="date" indexed="true" stored="true" />
   <field name="author" type="cistring" indexed="true" stored="true" />
   <field name="parent_author" type="cistring" indexed="true" stored="true" />
 </fields>

cistring is a case-insensitive string type i created:

   <fieldType name="cistring" class="solr.StrField" sortMissingLast="true"
omitNorms="true">
        <analyzer type="index">
                <tokenizer class="solr.LowerCaseTokenizerFactory"/>
        </analyzer>
        <analyzer type="query">
                <tokenizer class="solr.LowerCaseTokenizerFactory"/>
        </analyzer>
    </fieldType>