From user-return-5297-apmail-uima-user-archive=uima.apache.org@uima.apache.org Wed Aug 28 21:23:50 2013 Return-Path: X-Original-To: apmail-uima-user-archive@www.apache.org Delivered-To: apmail-uima-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E9CFF10BD2 for ; Wed, 28 Aug 2013 21:23:49 +0000 (UTC) Received: (qmail 74803 invoked by uid 500); 28 Aug 2013 21:23:49 -0000 Delivered-To: apmail-uima-user-archive@uima.apache.org Received: (qmail 74771 invoked by uid 500); 28 Aug 2013 21:23:49 -0000 Mailing-List: contact user-help@uima.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@uima.apache.org Delivered-To: mailing list user@uima.apache.org Received: (qmail 74763 invoked by uid 99); 28 Aug 2013 21:23:49 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Aug 2013 21:23:49 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of msa@schor.com designates 69.93.154.43 as permitted sender) Received: from [69.93.154.43] (HELO gateway10.websitewelcome.com) (69.93.154.43) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Aug 2013 21:23:41 +0000 Received: by gateway10.websitewelcome.com (Postfix, from userid 666) id 52E16FA21B4D; Wed, 28 Aug 2013 16:23:09 -0500 (CDT) Received: from gator3253.hostgator.com (gator3253.hostgator.com [198.57.247.217]) by gateway10.websitewelcome.com (Postfix) with ESMTP id 38050FA21B11 for ; Wed, 28 Aug 2013 16:23:09 -0500 (CDT) Received: from [129.34.20.23] (port=53924 helo=[9.2.211.29]) by gator3253.hostgator.com with esmtpsa (TLSv1:DHE-RSA-CAMELLIA256-SHA:256) (Exim 4.80) (envelope-from ) id 1VEnCy-00048I-H0 for user@uima.apache.org; Wed, 28 Aug 2013 16:23:20 -0500 Message-ID: <521E6A3A.10305@schor.com> Date: Wed, 28 Aug 2013 17:23:06 -0400 From: Marshall Schor User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:17.0) Gecko/20130801 Thunderbird/17.0.8 MIME-Version: 1.0 To: user@uima.apache.org Subject: Re: Increase heap size using UIMA with Solr References: In-Reply-To: X-Enigmail-Version: 1.5.2 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - gator3253.hostgator.com X-AntiAbuse: Original Domain - uima.apache.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - schor.com X-BWhitelist: no X-Source: X-Source-Args: X-Source-Dir: X-Source-Sender: ([9.2.211.29]) [129.34.20.23]:53924 X-Source-Auth: msa+schor.com X-Email-Count: 2 X-Source-Cap: bWlzY2hvcjttaXNjaG9yO2dhdG9yMzI1My5ob3N0Z2F0b3IuY29t X-Virus-Checked: Checked by ClamAV on apache.org This may be a better question for the Solr list. These issues seem to come from the particular integration of UIMA into SOLR, where it seems to be repeatedly instantiating new UIMA pipelines, over and over. In most application scenarios, it is intended that a UIMA pipeline be instantiated once, and then reused. -Marshall On 8/26/2013 4:20 AM, Jun Ohtani wrote: > Dear all, > > My co-worker use UIMA with Solr. > We have two problems increasing heap size and cpu usage. > > We have two question. > > 1. o.a.u.jcas.impl.JCasImpl.loadJCasClasses() call every requests. > Using UIMA with Solr, we send to request using UIMAUpdateRequestProcessor , Solr(Lucene) create AnalysisEngine instance every requests. > Maybe AnalysisEngine call loadJCasClasses() methods every request, and load CasType from classloader. > Why does Solr(Lucene) not cache an Analysis Engine instance? > > 2. o.a.u.analysis_emgine.impl.AnalysisEngineManagementImpl.usedRootNames increase entry. > The unique MBean name create classname and suffix number. > AnalysisEngineManagementImpl.setName() use HashSet to check unique MBean name. > Is it better using HashMap(classname, counter) Instead of HashSet ? > > > Regards > > ------------ > Jun Ohtani