Return-Path: X-Original-To: apmail-lucene-dev-archive@www.apache.org Delivered-To: apmail-lucene-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8E13E10741 for ; Sat, 7 Dec 2013 00:06:36 +0000 (UTC) Received: (qmail 92477 invoked by uid 500); 7 Dec 2013 00:06:35 -0000 Delivered-To: apmail-lucene-dev-archive@lucene.apache.org Received: (qmail 92416 invoked by uid 500); 7 Dec 2013 00:06:35 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 92408 invoked by uid 99); 7 Dec 2013 00:06:35 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 07 Dec 2013 00:06:35 +0000 Date: Sat, 7 Dec 2013 00:06:35 +0000 (UTC) From: "ASF subversion and git services (JIRA)" To: dev@lucene.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (LUCENE-5357) Upgrade StandardTokenizer & co to latest unicode rules MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/LUCENE-5357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13841918#comment-13841918 ] ASF subversion and git services commented on LUCENE-5357: --------------------------------------------------------- Commit 1548762 from [~steve_rowe] in branch 'dev/branches/branch_4x' [ https://svn.apache.org/r1548762 ] LUCENE-5357: Upgrade StandardTokenizer and UAX29URLEmailTokenizer to Unicode 6.3; update UAX29URLEmailTokenizer's recognized top level domains in URLs and Emails from the IANA Root Zone Database; add std40/StandardTokenizerImpl40 and std40/UAX29URLEmailTokenizerImpl40, for backcompat from 4.0->4.6. (merged trunk r1548595 and r1548746) > Upgrade StandardTokenizer & co to latest unicode rules > ------------------------------------------------------ > > Key: LUCENE-5357 > URL: https://issues.apache.org/jira/browse/LUCENE-5357 > Project: Lucene - Core > Issue Type: New Feature > Components: modules/analysis > Reporter: Robert Muir > Attachments: LUCENE-5357.patch > > > besides any change in data, the rules have also changed (regional indicators, better handling for hebrew, etc) -- This message was sent by Atlassian JIRA (v6.1#6144) --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org