lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "David Whalen" <>
Subject RE: Availability Issues
Date Mon, 08 Oct 2007 19:18:25 GMT
Hi Yonik.

> Do you see any requests that took a really long time to finish?

The requests that take a long time to finish are just simple
queries.  And the same queries run at a later time come back
much faster.

Our logs contain 99% inserts and 1% queries.  We are constantly
adding documents to the index at a rate of 10,000 per minute,
so the logs show mostly that.

> Start with the thread dump.
> I bet it's multiple queries piling up around some 
> synchronization points in lucene (sometimes caused by 
> multiple threads generating the same big filter that isn't 
> yet cached).

What would be my next steps after that?  I'm not sure I'd
understand enough from the dump to make heads-or-tails of
it.  Can I share that here?


> -----Original Message-----
> From: Yonik Seeley [] 
> Sent: Monday, October 08, 2007 3:01 PM
> To:
> Subject: Re: Availability Issues
> On 10/8/07, David Whalen <> wrote:
> > The logs show nothing but regular activity.  We do a "tail -f"
> > on the logfile and we can read it during the unresponsive 
> period and 
> > we don't see any errors.
> You don't see log entries for requests until after they complete.
> When a server becomes unresponsive, try shutting off further 
> traffic to it, and let it finish whatever requests it's 
> working on (assuming that's the issue) so you can see them in 
> the log.  Do you see any requests that took a really long 
> time to finish?
> -Yonik

View raw message