Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of lists@nabble.com designates
 216.139.236.158 as permitted sender)
Message-ID: <21611976.post@talk.nabble.com>
Date: Thu, 22 Jan 2009 12:00:53 -0800 (PST)
From: oleg_gnatovskiy <oleg_gnatovskiy@citysearch.com>
To: solr-user@lucene.apache.org
Subject: Re: Query Performance while updating teh index
In-Reply-To: <34128.62548.qm@web50310.mail.re2.yahoo.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
References: <20452835.post@talk.nabble.com>
 <c68e39170811121103t70ce7168lac6371fac2fed5bb@mail.gmail.com>
 <20467099.post@talk.nabble.com> <AEAE12308ACE45DA93250580ADCA91F0@madrid>
 <A7487BEC58632D46B8C7E8BC69B3EB120BE91398@mail-001.corp.automotive.com>
 <Pine.LNX.4.62.0811121425300.471@radix.cryptio.net>
 <20968516.post@talk.nabble.com> <574630.55488.qm@web50303.mail.re2.yahoo.com>
 <20980523.post@talk.nabble.com> <20980669.post@talk.nabble.com>
 <8599F2E4E80ECC44AEE81FA2974CE2BD0C31C942@mail-sd1.ad.soe.sony.com>
 <c68e39170812121109i26d2a9e6x4efeb14d3171cc56@mail.gmail.com>
 <21573927.post@talk.nabble.com> <485478.37082.qm@web50307.mail.re2.yahoo.com>
 <21611642.post@talk.nabble.com> <34128.62548.qm@web50310.mail.re2.yahoo.com>


We've tried it. There doesn't seem to be any connection between GC and the
bad performance spikes.


Otis Gospodnetic wrote:
> 
> OK.  Then it's likely not this.  You saw the other response about looking
> at GC to see if maybe that hits you once in a while and slows whatever
> queries are in flight?  Try jconsole.
> 
> Otis
> --
> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
> 
> 
> 
> ----- Original Message ----
>> From: oleg_gnatovskiy <oleg_gnatovskiy@citysearch.com>
>> To: solr-user@lucene.apache.org
>> Sent: Thursday, January 22, 2009 2:43:31 PM
>> Subject: Re: Query Performance while updating teh index
>> 
>> 
>> We do optimize the index before updates but we get tehse performance
>> issues
>> even when we pull an empty snapshot. Thus even when our update is tiny,
>> the
>> performance issues still happen.
>> 
>> 
>> 
>> Otis Gospodnetic wrote:
>> > 
>> > This is an old and long thread, and I no longer recall what the
>> specific
>> > suggestions were.
>> > My guess is this has to do with the OS cache of your index files.  When
>> > you make the large index update, that OS cache is useless (old files
>> are
>> > gone, new ones are in) and the OS cache has get re-warmed and this
>> takes
>> > time.
>> > 
>> > Are you optimizing your index before the update?  Do you *really* need
>> to
>> > do that?
>> > How large is your update, what makes it big, and could you make it
>> > smaller?
>> > 
>> > Otis
>> > --
>> > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>> > 
>> > 
>> > 
>> > ----- Original Message ----
>> >> From: oleg_gnatovskiy 
>> >> To: solr-user@lucene.apache.org
>> >> Sent: Tuesday, January 20, 2009 6:19:46 PM
>> >> Subject: Re: Query Performance while updating teh index
>> >> 
>> >> 
>> >> Hello again. It seems that we are still having these problems. Queries
>> >> take
>> >> as long as 20 minutes to get back to their average response time after
>> a
>> >> large index update, so it doesn't seem like the problem is the 12
>> second
>> >> autowarm time. Are there any more suggestions for things we can try?
>> >> Taking
>> >> our servers out of teh loop for as long as 20 minutes is a bit of a
>> >> hassle,
>> >> and a risk.
>> >> -- 
>> >> View this message in context: 
>> >> 
>> http://www.nabble.com/Query-Performance-while-updating-the-index-tp20452835p21573927.html
>> >> Sent from the Solr - User mailing list archive at Nabble.com.
>> > 
>> > 
>> > 
>> 
>> -- 
>> View this message in context: 
>> http://www.nabble.com/Query-Performance-while-updating-the-index-tp20452835p21611642.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
> 
> 
> 

-- 
View this message in context: http://www.nabble.com/Query-Performance-while-updating-the-index-tp20452835p21611976.html
Sent from the Solr - User mailing list archive at Nabble.com.