Return-Path: 
 <java-dev-return-13888-apmail-lucene-java-dev-archive=lucene.apache.org@lucene.apache.org>
Delivered-To: apmail-lucene-java-dev-archive@www.apache.org
Received: (qmail 69176 invoked from network); 15 May 2006 19:46:36 -0000
Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199)
  by minotaur.apache.org with SMTP; 15 May 2006 19:46:36 -0000
Received: (qmail 80927 invoked by uid 500); 15 May 2006 19:46:33 -0000
Delivered-To: apmail-lucene-java-dev-archive@lucene.apache.org
Received: (qmail 80894 invoked by uid 500); 15 May 2006 19:46:33 -0000
Mailing-List: contact java-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:java-dev-help@lucene.apache.org>
List-Unsubscribe: <mailto:java-dev-unsubscribe@lucene.apache.org>
List-Post: <mailto:java-dev@lucene.apache.org>
List-Id: <java-dev.lucene.apache.org>
Reply-To: java-dev@lucene.apache.org
Delivered-To: mailing list java-dev@lucene.apache.org
Received: (qmail 80883 invoked by uid 99); 15 May 2006 19:46:32 -0000
Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 15 May 2006 12:46:32 -0700
X-ASF-Spam-Status: No, hits=0.0 required=10.0
	tests=
X-Spam-Check-By: apache.org
Received: from [209.237.227.198] (HELO brutus.apache.org) (209.237.227.198)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 15 May 2006 12:46:32 -0700
Received: from brutus (localhost [127.0.0.1])
	by brutus.apache.org (Postfix) with ESMTP id E1FE3410007
	for <java-dev@lucene.apache.org>; Mon, 15 May 2006 19:46:05 +0000 (GMT)
Message-ID: <7152743.1147722365923.JavaMail.jira@brutus>
Date: Mon, 15 May 2006 19:46:05 +0000 (GMT+00:00)
From: "Tom Emerson (JIRA)" <jira@apache.org>
To: java-dev@lucene.apache.org
Subject: [jira] Created: (LUCENE-571) StandardTokenizer parses decimal
 number as <HOST>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-Virus-Checked: Checked by ClamAV on apache.org
X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N

StandardTokenizer parses decimal number as <HOST>
-------------------------------------------------

         Key: LUCENE-571
         URL: http://issues.apache.org/jira/browse/LUCENE-571
     Project: Lucene - Java
        Type: Bug

  Components: Analysis  
    Versions: 1.9    
    Reporter: Tom Emerson
    Priority: Minor


The standard tokenizer in 1.9.1 returns a decimal number such as "3.14" as a <HOST>, though a number like "3,141.59" is returned as a <NUM>. I believe, though I haven't tried it yet, that moving the rule for <HOST> after <NUM>, instead of before it, will obviate this. Or updating <HOST> to require a TLD as the last component, which would require you to split the interpretation of IP addresses from name-based addresses.


-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org