lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Muir <rcm...@gmail.com>
Subject Re: prohibit jflex generation of Tokenizer(InputStream) that uses system default charset?
Date Sun, 08 Jul 2012 15:13:40 GMT
Thanks Uwe! this is a good solution for now :)

On Sun, Jul 8, 2012 at 11:11 AM, Uwe Schindler <uwe@thetaphi.de> wrote:
> I copied the workaround from HTMLCharFilter to StandardTokenizer's code generator. There
was a regex, stripping those ctors - unfortunately this regex depends on a missing period
in the javadocs (was not able to fix it lazy, non-greedy,... or whatever regex like).
>
> See my commit in the lucene4199 branch.
>
> -----
> Uwe Schindler
> H.-H.-Meier-Allee 63, D-28213 Bremen
> http://www.thetaphi.de
> eMail: uwe@thetaphi.de
>
>
>> -----Original Message-----
>> From: Robert Muir [mailto:rcmuir@gmail.com]
>> Sent: Sunday, July 08, 2012 2:32 PM
>> To: dev@lucene.apache.org
>> Subject: prohibit jflex generation of Tokenizer(InputStream) that uses system
>> default charset?
>>
>> Have a look at StandardTokenizerImpl:769
>>
>>   /**
>>    * Creates a new scanner.
>>    * There is also java.io.Reader version of this constructor.
>>    *
>>    * @param   in  the java.io.Inputstream to read input from.
>>    */
>>   public StandardTokenizerImpl(java.io.InputStream in) {
>>     this(new java.io.InputStreamReader(in));
>>   }
>>
>> Is there any jflex option to prevent generating this?
>>
>> --
>> lucidimagination.com
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional
>> commands, e-mail: dev-help@lucene.apache.org
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>



-- 
lucidimagination.com

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message