Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of Vitaly_Artemov@mcafee.com
 designates 161.69.47.167 as permitted sender)
From: <Vitaly_Artemov@McAfee.com>
To: <java-user@lucene.apache.org>
Subject: RE: Lucene 4.0 scalability and performance.
Thread-Topic: Lucene 4.0 scalability and performance.
Thread-Index: Ac3g+1Lu49Wk7fxfRg+SNRBPRuu4PgBCKcGAAApMyfA=
Date: Mon, 24 Dec 2012 13:30:09 +0000
Message-ID: 
 <7B17ABD38A7A234E8C7D4462A26A489B0861669B@MIVEXEMEA1N1.corp.nai.org>
References: 
 <7B17ABD38A7A234E8C7D4462A26A489B086162B1@MIVEXEMEA1N1.corp.nai.org>
 <50D857A9.7010502@ids-mannheim.de>
In-Reply-To: <50D857A9.7010502@ids-mannheim.de>
Accept-Language: en-US
Content-Language: en-US
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

Thank you

-----Original Message-----
From: Carsten Schnober [mailto:schnober@ids-mannheim.de]=20
Sent: Monday, December 24, 2012 3:25 PM
To: java-user@lucene.apache.org
Subject: Re: Lucene 4.0 scalability and performance.

Am 23.12.2012 12:11, schrieb Vitaly_Artemov@McAfee.com:


> This means that we need to index millions of document with TeraBytes of c=
ontent and search in it.
> For now we want to define only one indexed field, contained the content o=
f the documents, with possibility to search terms and retrieving the terms =
offsets.
> Does somebody already tested Lucene with TerabBytes of data?
> Does Lucene has some known limitations related to the indexed documents n=
umber or to the indexed documents size?
> What is about search performance in huge set of data?

Hi Vitali,
we've been working on a linguistic search engine based on Lucene 4.0 and ha=
ve performed a few tests with large text corpora. There are at least some o=
verlaps in the functionality you mentioned (term offsets). See http://www.o=
egai.at/konvens2012/proceedings/27_schnober12p/ (mainly section 5).
Carsten

--
Institut f=FCr Deutsche Sprache | http://www.ids-mannheim.de
Projekt KorAP                 | http://korap.ids-mannheim.de
Tel. +49-(0)621-43740789      | schnober@ids-mannheim.de
Korpusanalyseplattform der n=E4chsten Generation Next Generation Corpus Ana=
lysis Platform

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org