Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: message received from 54.191.145.13
 which is an MX secondary for java-user@lucene.apache.org)
From: "Uwe Schindler" <uwe@thetaphi.de>
To: <java-user@lucene.apache.org>
References: 
 <CAFD_z_9YOW32v3DXneSTM7dQS23KWdJL-Q0ZF_ZAZsHU1p+zBg@mail.gmail.com>
 <00ca01d07f32$a20ce1f0$e626a5d0$@thetaphi.de>
In-Reply-To: <00ca01d07f32$a20ce1f0$e626a5d0$@thetaphi.de>
Subject: RE: StandardTokenizerImpl generation question
Date: Sat, 25 Apr 2015 11:13:38 +0200
Message-ID: <00d401d07f38$1e3a55a0$5aaf00e0$@thetaphi.de>
MIME-Version: 1.0
Content-Type: text/plain;
	charset="utf-8"
Content-Transfer-Encoding: quoted-printable
Thread-Index: AQGZ/GMJDcDr/lV7C7ikIrWM7P7N8wK6vORVnbShBzA=
Content-Language: de

Hi,

I checked the source codes of Lucene, there is no such warning anymore. =
Which version do you use and in which file did you find the warning? In =
any case, for older versions of Lucene you should really use the version =
mentioned there to regenerate, to be sure the behavior of the Tokenizer =
is the one you want to have.

It is easy to do if you use the corresponding ANT task for regenerating =
("ant jflex" or "ant regenerate").

Uwe

-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de


> -----Original Message-----
> From: Uwe Schindler [mailto:uwe@thetaphi.de]
> Sent: Saturday, April 25, 2015 10:34 AM
> To: java-user@lucene.apache.org
> Subject: RE: StandardTokenizerImpl generation question
>=20
> Hi,
>=20
> the documentation is this file is not really up-to-date.
>=20
> If you want to regenerate the jflex files, it is recommended to use =
the build
> script of Lucene. If you type "ant regenerate" or "ant jflex" (in the =
folder of
> the analysis module), the build system will download the correct =
version of
> JFlex and regenerate the scripts. Currently this is version 1.6.0. The =
warning
> was primarily there because of older versions of JFlex that used the =
Unicode
> version of  the JVM which is no longer the case.
>=20
> Could you may be open an issue to update the documentation in the =
files?
>=20
> Uwe
>=20
> -----
> Uwe Schindler
> H.-H.-Meier-Allee 63, D-28213 Bremen
> http://www.thetaphi.de
> eMail: uwe@thetaphi.de
>=20
> > -----Original Message-----
> > From: Youngho Cho [mailto:youngho1203@gmail.com]
> > Sent: Saturday, April 25, 2015 4:40 AM
> > To: java-user@lucene.apache.org
> > Subject: StandardTokenizerImpl generation question
> >
> > Hello,
> >
> > I would like to generate my own tokenizer which is slightly modify =
the
> > StandardTokenizerImpl*.jflex.
> >
> > But I read the READ_BEFORE_GENERATING.txt.
> >
> > Currently, the jflex version is 1.6.1. but the document recommend to
> > use jflex 1.5 only.
> >
> > Still this message is valid and do I have to generate a tokenizer
> > using old version of jflex ?
> >
> >
> > Thanks,
> >
> > Youngho
> >
> > =
---------------------------------------------------------------------
> > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> > For additional commands, e-mail: java-user-help@lucene.apache.org
>=20
>=20
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org