Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of lists@nabble.com designates
 216.139.236.158 as permitted sender)
Message-ID: <20467281.post@talk.nabble.com>
Date: Wed, 12 Nov 2008 11:16:44 -0800 (PST)
From: oleg_gnatovskiy <oleg_gnatovskiy@citysearch.com>
To: solr-user@lucene.apache.org
Subject: Re: Query Performance while updating teh index
In-Reply-To: <c68e39170811121112s694915c4p56c63c0cf0468a55@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
References: <20452835.post@talk.nabble.com>
 <c68e39170811121103t70ce7168lac6371fac2fed5bb@mail.gmail.com>
 <20467099.post@talk.nabble.com>
 <c68e39170811121112s694915c4p56c63c0cf0468a55@mail.gmail.com>


Yonik Seeley wrote:
> 
> On Wed, Nov 12, 2008 at 2:06 PM, oleg_gnatovskiy
> <oleg_gnatovskiy@citysearch.com> wrote:
>> The rsync seems to have nothing to do with slowness, because while the
>> rsync
>> is going on, there isn't any reload occurring, once the files are on the
>> system, it tries a curl request to reload the searcher, which at that
>> point
>> causes the delays. The file transfer probably has nothing to do with
>> this.
>> Does this mean that it happens during warming?
> 
> Yes, it would seem so.
> It could either be that 1) warming the new reader slows down the
> current reader used to service queries
> or 2) the first queries to come into the new reader are slow (which
> can be solved with some static warming queries to load sort fields,
> facet caches, etc).
> 
> How many CPUs does the box have that you are running on?  What OS?
> 
> -Yonik
> 
> 
> 
>> Yonik Seeley wrote:
>>>
>>> On Tue, Nov 11, 2008 at 9:31 PM, oleg_gnatovskiy
>>> <oleg_gnatovskiy@citysearch.com> wrote:
>>>> Hello. We have an index with 15 million documents working on a
>>>> distributed
>>>> environment, with an index distribution setup. While an index on a
>>>> slave
>>>> server is being updated, query response times become extremely slow
>>>> (upwards
>>>> of 5 seconds). Is there any way to decrease the hit query response
>>>> times
>>>> take while an index is being pushed?
>>>
>>> Can you tell why it's getting slow?  Is this during warming, or does
>>> it begin during the actual transfer of the new index?
>>>
>>> One possibility is that the new index being copied forces out parts of
>>> the old index from the OS cache.  More memory would help in that
>>> scenario.
>>>
>>> -Yonik
>>>
>>>
>>
>> --
>> View this message in context:
>> http://www.nabble.com/Query-Performance-while-updating-the-index-tp20452835p20467099.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>>
> 
> 

8 CPUs and Linux OS

-- 
View this message in context: http://www.nabble.com/Query-Performance-while-updating-the-index-tp20452835p20467281.html
Sent from the Solr - User mailing list archive at Nabble.com.