Return-Path: X-Original-To: apmail-uima-user-archive@www.apache.org Delivered-To: apmail-uima-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4AA9B178C3 for ; Wed, 20 May 2015 13:10:54 +0000 (UTC) Received: (qmail 12927 invoked by uid 500); 20 May 2015 13:10:54 -0000 Delivered-To: apmail-uima-user-archive@uima.apache.org Received: (qmail 12887 invoked by uid 500); 20 May 2015 13:10:54 -0000 Mailing-List: contact user-help@uima.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@uima.apache.org Delivered-To: mailing list user@uima.apache.org Received: (qmail 12867 invoked by uid 99); 20 May 2015 13:10:53 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 20 May 2015 13:10:53 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 2FD0F1A3799 for ; Wed, 20 May 2015 13:10:53 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.991 X-Spam-Level: X-Spam-Status: No, score=0.991 tagged_above=-999 required=6.31 tests=[HEADER_FROM_DIFFERENT_DOMAINS=0.001, KAM_LAZY_DOMAIN_SECURITY=1, T_RP_MATCHES_RCVD=-0.01] autolearn=disabled Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id el2rLy25gOcC for ; Wed, 20 May 2015 13:10:52 +0000 (UTC) Received: from machine.or.cz (pasky.or.cz [84.242.80.195]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTP id 0EA4422F28 for ; Wed, 20 May 2015 13:10:52 +0000 (UTC) Received: by machine.or.cz (Postfix, from userid 2001) id 8392C4820FE9; Wed, 20 May 2015 15:10:44 +0200 (CEST) Date: Wed, 20 May 2015 15:10:44 +0200 From: Petr Baudis To: user@uima.apache.org Subject: Re: Multi-threaded UIMA ParallelStep Message-ID: <20150520131043.GK2760@machine.or.cz> References: <20150520012720.GC2760@machine.or.cz> <20150520124950.GJ2760@machine.or.cz> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.23 (2014-03-12) Hi! On Wed, May 20, 2015 at 09:01:10AM -0400, Eddie Epstein wrote: > Right about the flow controller. That's where UIMA-AS comes in. Assuming > that the CM has a casPool with enough CASes, and the aggregate is deployed > asynchronously, then each delegate will be running in its own thread and > can be processing CASes in parallel. > > The ASB is a single-theaded controller used for deployment of synchronous > aggregates. Hmm, I think I begin to see how it should work. Thanks for the explanation! However, (before actually trying) it still seems to me to be much easier to rewrite a piece of the stock ASB than use UIMA-AS with complex pipeline construed by UIMAfit... So I think I will try that first (and report back). > Is the intention here to use parallel processing to reduce latency for a > interactive application or to increase throughput for batch processing? For > throughput, why not just deploy the entire pipeline single-threaded and > then run multiple pipeline instances in separate threads? UIMA-AS would do > this by specifying N instances of a synchronous top-level aggregate. The intention is to do both, latency is also important for me as I have an interactive user interface for the pipeline. Petr Baudis