Return-Path: Delivered-To: apmail-lucene-solr-commits-archive@minotaur.apache.org Received: (qmail 23563 invoked from network); 15 Dec 2010 22:51:16 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 15 Dec 2010 22:51:16 -0000 Received: (qmail 82438 invoked by uid 500); 15 Dec 2010 22:51:16 -0000 Delivered-To: apmail-lucene-solr-commits-archive@lucene.apache.org Received: (qmail 82410 invoked by uid 500); 15 Dec 2010 22:51:16 -0000 Mailing-List: contact solr-commits-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-dev@lucene.apache.org Delivered-To: mailing list solr-commits@lucene.apache.org Received: (qmail 82403 invoked by uid 99); 15 Dec 2010 22:51:16 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Dec 2010 22:51:16 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.131] (HELO eos.apache.org) (140.211.11.131) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Dec 2010 22:51:15 +0000 Received: from eosnew.apache.org (localhost [127.0.0.1]) by eos.apache.org (Postfix) with ESMTP id 47F82427; Wed, 15 Dec 2010 22:50:55 +0000 (UTC) MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable From: Apache Wiki To: Apache Wiki Date: Wed, 15 Dec 2010 22:50:55 -0000 Message-ID: <20101215225055.94205.37235@eosnew.apache.org> Subject: =?utf-8?q?=5BSolr_Wiki=5D_Trivial_Update_of_=22AnalyzersTokenizersTokenFi?= =?utf-8?q?lters=22_by_SteveRowe?= Dear Wiki user, You have subscribed to a wiki page or wiki category on "Solr Wiki" for chan= ge notification. The "AnalyzersTokenizersTokenFilters" page has been changed by SteveRowe. http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters?action=3Ddiff&r= ev1=3D99&rev2=3D100 -------------------------------------------------- In addition to the token types output by !StandardTokenizer from [[Solr3.= 1]] onward, !UAX29URLEmailTokenizer can also output `` and `` t= oken types. = . Example: `"Visit http://accarol.com/contact.htm?from=3Dexternal&a=3D10= or e-mail bob.cratchet@accarol.com"` = - . `=3D=3D> ALPHANUM:"Visit", URL: "http://accarol.com/contact.htm?from= =3Dexternal&a=3D10", ALPHANUM:"or", ALPHANUM:"e-mail" EMAIL:"bob.cratchet@a= ccarol.com"` + . `=3D=3D> ALPHANUM:"Visit", URL:"http://accarol.com/contact.htm?from=3D= external&a=3D10", ALPHANUM:"or", ALPHANUM:"e-mail" EMAIL:"bob.cratchet@acca= rol.com"` = ||'''arg''' ||'''default value''' ||'''note''' || ||maxTokenLength ||255 || [[Solr3.1]] -- [[https://issues.apache.org/= jira/browse/SOLR-2188|SOLR-2188]]<
>Tokens longer than `maxTokenLength` = are silently ignored. ||