Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (nike.apache.org: message received from 54.76.25.247 which
 is an MX secondary for java-user@lucene.apache.org)
MIME-Version: 1.0
In-Reply-To: <00d401d07f38$1e3a55a0$5aaf00e0$@thetaphi.de>
References: 
 <CAFD_z_9YOW32v3DXneSTM7dQS23KWdJL-Q0ZF_ZAZsHU1p+zBg@mail.gmail.com>
	<00ca01d07f32$a20ce1f0$e626a5d0$@thetaphi.de>
	<00d401d07f38$1e3a55a0$5aaf00e0$@thetaphi.de>
Date: Sat, 25 Apr 2015 20:35:54 +0900
Message-ID: 
 <CAFD_z_-DigbjD4ZLz21bQTpfpwdpkOctBMuc0diafKhaRM4Wcg@mail.gmail.com>
Subject: Re: StandardTokenizerImpl generation question
From: Youngho Cho <youngho1203@gmail.com>
To: java-user@lucene.apache.org
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hello Uwe Schindler,

Ah, Yes.
You are right.
5.x removed that message file.
I am still in 4.x. ( 4.10.4 has this file ) so far.


Thanks for your kind consideration.

Youngho


2015-04-25 18:13 GMT+09:00 Uwe Schindler <uwe@thetaphi.de>:
> Hi,
>
> I checked the source codes of Lucene, there is no such warning anymore. W=
hich version do you use and in which file did you find the warning? In any =
case, for older versions of Lucene you should really use the version mentio=
ned there to regenerate, to be sure the behavior of the Tokenizer is the on=
e you want to have.
>
> It is easy to do if you use the corresponding ANT task for regenerating (=
"ant jflex" or "ant regenerate").
>
> Uwe
>
> -----
> Uwe Schindler
> H.-H.-Meier-Allee 63, D-28213 Bremen
> http://www.thetaphi.de
> eMail: uwe@thetaphi.de
>
>
>> -----Original Message-----
>> From: Uwe Schindler [mailto:uwe@thetaphi.de]
>> Sent: Saturday, April 25, 2015 10:34 AM
>> To: java-user@lucene.apache.org
>> Subject: RE: StandardTokenizerImpl generation question
>>
>> Hi,
>>
>> the documentation is this file is not really up-to-date.
>>
>> If you want to regenerate the jflex files, it is recommended to use the =
build
>> script of Lucene. If you type "ant regenerate" or "ant jflex" (in the fo=
lder of
>> the analysis module), the build system will download the correct version=
 of
>> JFlex and regenerate the scripts. Currently this is version 1.6.0. The w=
arning
>> was primarily there because of older versions of JFlex that used the Uni=
code
>> version of  the JVM which is no longer the case.
>>
>> Could you may be open an issue to update the documentation in the files?
>>
>> Uwe
>>
>> -----
>> Uwe Schindler
>> H.-H.-Meier-Allee 63, D-28213 Bremen
>> http://www.thetaphi.de
>> eMail: uwe@thetaphi.de
>>
>> > -----Original Message-----
>> > From: Youngho Cho [mailto:youngho1203@gmail.com]
>> > Sent: Saturday, April 25, 2015 4:40 AM
>> > To: java-user@lucene.apache.org
>> > Subject: StandardTokenizerImpl generation question
>> >
>> > Hello,
>> >
>> > I would like to generate my own tokenizer which is slightly modify the
>> > StandardTokenizerImpl*.jflex.
>> >
>> > But I read the READ_BEFORE_GENERATING.txt.
>> >
>> > Currently, the jflex version is 1.6.1. but the document recommend to
>> > use jflex 1.5 only.
>> >
>> > Still this message is valid and do I have to generate a tokenizer
>> > using old version of jflex ?
>> >
>> >
>> > Thanks,
>> >
>> > Youngho
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> > For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org