Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: local policy)
Content-class: urn:content-classes:message
MIME-Version: 1.0
Content-Type: text/plain;
	charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
Subject: RE: ArrayIndexOutOfBoundsException in FastCharStream.readChar
Date: Mon, 6 Oct 2008 15:18:20 -0400
Message-ID: <9294E20AED46934EA459020706463F94EF3C62@SUEXCL-02.ad.syr.edu>
In-Reply-To: <398902.79159.qm@web53502.mail.re2.yahoo.com>
Thread-Topic: ArrayIndexOutOfBoundsException in FastCharStream.readChar
Thread-Index: Ackn4iFED+Fp5lM8SbuLROXHI3dM2QABRt8A
From: "Steven A Rowe" <sarowe@syr.edu>
To: <java-user@lucene.apache.org>

Hi Edwin,

I don't know specifically what's causing the exception you're seeing, =
but note that in Lucene 2.3.0+, the JavaCC-generated version of =
StandardTokenizer (where your exception originates) has been replaced =
with a JFlex-generated version - see =
<http://issues.apache.org/jira/browse/LUCENE-966>.

FYI, indexing speed was much improved in 2.3.0 over previous versions -- =
up to 10 times faster, according to reports on this list -- is there any =
particular reason you aren't using 2.3.2 (the most recent release)?

Steve

On 10/06/2008 at 2:32 PM, Edwin Smith wrote:
> Oh, and in case it matters, I'm using Lucene 2.2.0.
>=20
> Ed
>=20
>=20
>=20
> ----- Original Message ----
>=20
>=20
> I am stumped and have not seen any other reference to this
> problem. I am getting the following exception on everything I
> try to index. Does anyone know what my problem might be?
>=20
> Thanks,
>=20
> Ed
>=20
> java.lang.ArrayIndexOutOfBoundsException at
> org.apache.lucene.analysis.standard.FastCharStream.readChar( at
> org.apache.lucene.analysis.standard.FastCharStream.BeginToken( at
> org.apache.lucene.analysis.standard.StandardTokenizerTokenMana
> ger.getNextToken( at
> org.apache.lucene.analysis.standard.StandardTokenizer.jj_ntk( at
> org.apache.lucene.analysis.standard.StandardTokenizer.next( at
> org.apache.lucene.analysis.standard.StandardFilter.next( at
> org.apache.lucene.analysis.LowerCaseFilter.next( at
> org.apache.lucene.analysis.StopFilter.next( at
> org.apache.lucene.index.DocumentWriter.invertDocument( at
> org.apache.lucene.index.DocumentWriter.addDocument( at
> org.apache.lucene.index.IndexWriter.buildSingleDocSegment( at
> org.apache.lucene.index.IndexWriter.addDocument( at
> org.apache.lucene.index.IndexWriter.addDocument( at
> com.affinovate.v4.server.search.Indexer.index( at
> com.affinovate.v4.server.search.Indexer.perform( at
> com.affinovate.v4.server.db.TaskQueue.run( at java.lang.Thread.run(:
> 2048FastCharStream.java:46)FastCharStream.java:79)StandardToke
> nizerTokenManager.java:1180)StandardTokenizer.java:158)Standar
> dTokenizer.java:36)StandardFilter.java:41)LowerCaseFilter.java
> > 33)StopFilter.java:107)DocumentWriter.java:219)DocumentWriter
> .java:95)IndexWriter.java:1013)IndexWriter.java:1001)IndexWrit
> er.java:983)Indexer.java:61)Indexer.java:93)TaskQueue.java:115
> )Thread.java:619)
>

=20


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org