Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 22997 invoked from network); 18 Nov 2008 10:43:20 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 18 Nov 2008 10:43:20 -0000 Received: (qmail 16366 invoked by uid 500); 18 Nov 2008 10:43:21 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 16343 invoked by uid 500); 18 Nov 2008 10:43:21 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 16332 invoked by uid 99); 18 Nov 2008 10:43:21 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Nov 2008 02:43:21 -0800 X-ASF-Spam-Status: No, hits=1.4 required=10.0 tests=SPF_NEUTRAL,WHOIS_MYPRIVREG X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [209.85.221.20] (HELO mail-qy0-f20.google.com) (209.85.221.20) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Nov 2008 10:41:56 +0000 Received: by qyk13 with SMTP id 13so891482qyk.5 for ; Tue, 18 Nov 2008 02:42:39 -0800 (PST) Received: by 10.214.244.14 with SMTP id r14mr3684621qah.93.1227004959765; Tue, 18 Nov 2008 02:42:39 -0800 (PST) Received: from ?10.17.4.4? (pool-96-237-252-30.bstnma.fios.verizon.net [96.237.252.30]) by mx.google.com with ESMTPS id 9sm6289456ywf.2.2008.11.18.02.42.38 (version=TLSv1/SSLv3 cipher=RC4-MD5); Tue, 18 Nov 2008 02:42:38 -0800 (PST) Message-Id: From: Michael McCandless To: java-user@lucene.apache.org In-Reply-To: <20550488.post@talk.nabble.com> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Subject: Re: Lucene 2.4 Token Stream error Date: Tue, 18 Nov 2008 05:42:36 -0500 References: <20550488.post@talk.nabble.com> X-Mailer: Apple Mail (2.929.2) X-Virus-Checked: Checked by ClamAV on apache.org Can you post the code fragment in AccentFilter.java that's setting the Token? In 2.4 we added that check (for IllegalArgumentException) to ensure you don't setTermLength to something longer than the current term buffer. You should call resizeTermBuffer() first, then fill in the char[] for the token, then call setTermLength. Mike bhupesh bansal wrote: > > Hey folks, > > I saw this error in my code base after upgrading lucene-2.4 from > lucene 2.3. > have folks seen this before and any idea ?? is it related to fix of > https://issues.apache.org/jira/browse/LUCENE-1333 > > java.lang.IllegalArgumentException: length 11 exceeds the size of the > termBuffer (10) > at org.apache.lucene.analysis.Token.setTermLength(Token.java: > 526) > at > com > .linkedin > .search.pub.stemming.impl.filter.AccentFilter.next(AccentFilter.java: > 42) > at > org.apache.lucene.analysis.LowerCaseFilter.next(LowerCaseFilter.java: > 34) > at > org.apache.lucene.analysis.TokenStream.next(TokenStream.java:47) > at > com > .linkedin > .search > .pub.stemming.impl.filter.PushbackFilter.next(PushbackFilter.java:52) > at > com > .linkedin > .search > .pub > .stemming.impl.filter.rewrite.RewriteFilter.next(RewriteFilter.java: > 58) > at > com > .linkedin > .search > .pub > .stemming.impl.filter.rewrite.RewriteFilter.next(RewriteFilter.java: > 70) > at > com > .linkedin > .search > .pub > .stemming.impl.filter.rewrite.RewriteFilter.next(RewriteFilter.java: > 39) > at org.apache.lucene.analysis.StopFilter.next(StopFilter.java: > 120) > at > org.apache.lucene.analysis.TokenStream.next(TokenStream.java:47) > -- > View this message in context: http://www.nabble.com/Lucene-2.4-Token-Stream-error-tp20550488p20550488.html > Sent from the Lucene - Java Users mailing list archive at Nabble.com. > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org > For additional commands, e-mail: java-user-help@lucene.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org