Return-Path: X-Original-To: apmail-lucene-java-user-archive@www.apache.org Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 45F0C11782 for ; Thu, 15 May 2014 03:07:46 +0000 (UTC) Received: (qmail 65425 invoked by uid 500); 14 May 2014 15:48:35 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 65362 invoked by uid 500); 14 May 2014 15:48:35 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 65354 invoked by uid 99); 14 May 2014 15:48:35 -0000 Received: from Unknown (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 14 May 2014 15:48:35 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of rcmuir@gmail.com designates 209.85.212.171 as permitted sender) Received: from [209.85.212.171] (HELO mail-wi0-f171.google.com) (209.85.212.171) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 14 May 2014 15:48:31 +0000 Received: by mail-wi0-f171.google.com with SMTP id hm4so8275903wib.4 for ; Wed, 14 May 2014 08:48:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=6eUKd0i4lsRlxgYhz309QnjsWiahdakAULIfSPZUlg8=; b=r3uJBzwXuDEu4Luw/hW5/7adhdPULcITzUKLR6jEe4QAwKH4koshFDfpINtNYNX2Ro wdhINEJcVZyjP0GUIwMSZm+Rnp+KNAImZNm5IdwGEk9Sb2QJxlyPyub4ZiWKUQfkJboK jI0kfJ2Y7vQFLWRgmqKSa0zaiPJUbP9fFQB4jypEv68cKr13PxiUu8zBhEKWVXX/mGCG bopFEJ2NJI2Bi8q0Ofe0lH0vgfR+W8wEFoUk1PQUpmq+rQrbX5PBsnLq8cLqfpJw8nZs Fq87jSm+LaM3vGRMY2pApE+aEISKlf9NghVj8TpIy09EBjeFYrUY5p/C0bl08TBxeimp UEJQ== X-Received: by 10.180.106.194 with SMTP id gw2mr4075343wib.47.1400082490151; Wed, 14 May 2014 08:48:10 -0700 (PDT) MIME-Version: 1.0 Received: by 10.194.59.83 with HTTP; Wed, 14 May 2014 08:47:50 -0700 (PDT) In-Reply-To: References: From: Robert Muir Date: Wed, 14 May 2014 11:47:50 -0400 Message-ID: Subject: Re: ConcurrentModificationException in ICU analyzer To: java-user Content-Type: text/plain; charset=UTF-8 X-Virus-Checked: Checked by ClamAV on apache.org fyi: this bug was already found and fixed in ICU's trunk: http://bugs.icu-project.org/trac/ticket/10767 On Wed, May 14, 2014 at 4:32 AM, Robert Muir wrote: > This looks like a bug in ICU? I'll try to reproduce it. We are also a > little out of date, maybe they've already fixed it. > > Thank you for reporting this. > > On Fri, May 9, 2014 at 12:14 PM, feedly team wrote: >> I am using the 4.7.0 ICU analyzer (via elastic search) and noticed this >> exception in the logs. It's sporadic. Any ideas what is going on or if this >> is already fixed: >> >> java.util.ConcurrentModificationException >> >> at java.util.HashMap$HashIterator.nextEntry(HashMap.java:894) >> >> at java.util.HashMap$KeyIterator.next(HashMap.java:928) >> >> at >> com.ibm.icu.text.RuleBasedBreakIterator.getEngineFor(RuleBasedBreakIterator.java:1011) >> >> at >> com.ibm.icu.text.RuleBasedBreakIterator.handleNext(RuleBasedBreakIterator.java:1085) >> >> at >> com.ibm.icu.text.RuleBasedBreakIterator.next(RuleBasedBreakIterator.java:449) >> >> at >> org.apache.lucene.analysis.icu.segmentation.BreakIteratorWrapper$RBBIWrapper.next(BreakIteratorWrapper.java:96) >> >> at >> org.apache.lucene.analysis.icu.segmentation.CompositeBreakIterator.next(CompositeBreakIterator.java:60) >> >> at >> org.apache.lucene.analysis.icu.segmentation.ICUTokenizer.incrementTokenBuffer(ICUTokenizer.java:212) >> >> at >> org.apache.lucene.analysis.icu.segmentation.ICUTokenizer.incrementToken(ICUTokenizer.java:106) >> >> at >> org.apache.lucene.analysis.icu.ICUNormalizer2Filter.incrementToken(ICUNormalizer2Filter.java:80) >> >> at >> org.apache.lucene.analysis.miscellaneous.KeywordMarkerFilter.incrementToken(KeywordMarkerFilter.java:45) >> >> at >> org.apache.lucene.analysis.util.FilteringTokenFilter.incrementToken(FilteringTokenFilter.java:82) >> >> at >> org.apache.lucene.analysis.en.EnglishPossessiveFilter.incrementToken(EnglishPossessiveFilter.java:57) >> >> at >> org.apache.lucene.analysis.util.ElisionFilter.incrementToken(ElisionFilter.java:52) >> >> at >> org.apache.lucene.analysis.icu.ICUNormalizer2Filter.incrementToken(ICUNormalizer2Filter.java:80) >> >> at >> org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:182) >> >> at >> org.apache.lucene.index.DocFieldProcessor.processDocument(DocFieldProcessor.java:248) >> >> at >> org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:253) >> >> at >> org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:455) >> >> at >> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1534) >> >> at >> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1204) >> >> at >> org.elasticsearch.index.engine.internal.InternalEngine.innerCreate(InternalEngine.java:451) >> >> at >> org.elasticsearch.index.engine.internal.InternalEngine.create(InternalEngine.java:382) >> >> at >> org.elasticsearch.index.shard.service.InternalIndexShard.create(InternalIndexShard.java:374) >> >> at >> org.elasticsearch.action.bulk.TransportShardBulkAction.shardIndexOperation(TransportShardBulkAction.java:431) >> >> at >> org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:160) >> >> at >> org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction.performOnPrimary(TransportShardReplicationOperationAction.java:556) >> >> at >> org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction$1.run(TransportShardReplicationOperationAction.java:426) >> >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) >> >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) >> >> at java.lang.Thread.run(Thread.java:722) --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org