Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@lucene.apache.org
Received-SPF: pass (nike.apache.org: domain of yseeley@gmail.com designates
 74.125.82.176 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:sender:reply-to:in-reply-to:references:date
         :x-google-sender-auth:message-id:subject:from:to:content-type
         :content-transfer-encoding;
        b=bYzaZESdr+veCpjsVSrQoNBkLaleyXjMg9n0iS+T/DF0XBLOBZ5hjyotm5ZewWkP0k
         Xl3ATjUadKhXsxdZIVxDLqY4F6DkbcH6VP6Ar5l3p59rn7BVlQy/bRqm1ZOngrMzv0Cf
         kS9lcznCbwv1FvcvOtpGkIgis5nTDimqmZ90k=
MIME-Version: 1.0
Sender: yseeley@gmail.com
Reply-To: yonik@lucidimagination.com
In-Reply-To: <35030446-B726-4141-AF52-FE641C121E48@cominvent.com>
References: <35030446-B726-4141-AF52-FE641C121E48@cominvent.com>
Date: Tue, 28 Sep 2010 10:40:21 -0400
Message-ID: <AANLkTinx7KJvuFRbKLcd3VW7Ojk=v1ikoKFv1y-d2oLu@mail.gmail.com>
Subject: Re: Indexing and threads
From: Yonik Seeley <yonik@lucidimagination.com>
To: dev@lucene.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

On Tue, Sep 28, 2010 at 9:32 AM, Jan H=F8ydahl / Cominvent
<jan.asf@cominvent.com> wrote:
> How are threads being used when indexing?
>
> Let's say document A and B are ingested in parallell to XMLUpdateRequestH=
andler in two separate threads.
> How far down the chain are the processing of these done in the two separa=
te threads?

All the way to the Lucene IndexWriter, where they are also processed
in parallel.

> Is the full UpdateRequestChain run in the same thread as the incoming req=
uest?

Yes.

> Is analysis done in the request thread or in a single indexing thread?

Request thread.

> Are ADDs added to the same "commit queue", and then from COMMIT and down =
to Lucene segment building everything is single-threaded?

While a commit is happening in Solr, adds are blocked.  This is
historical - in the past, Lucene didn't really handle that type of
concurrency for you, and so Solr did.  We need to improve this at some
point...

-Yonik
http://lucenerevolution.org  Lucene/Solr Conference, Boston Oct 7-8

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org