From user-return-7899-archive-asf-public=cust-asf.ponee.io@uima.apache.org Wed Apr 11 15:47:35 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 535EF18064A for ; Wed, 11 Apr 2018 15:47:35 +0200 (CEST) Received: (qmail 67542 invoked by uid 500); 11 Apr 2018 13:47:34 -0000 Mailing-List: contact user-help@uima.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@uima.apache.org Delivered-To: mailing list user@uima.apache.org Received: (qmail 67530 invoked by uid 99); 11 Apr 2018 13:47:33 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Apr 2018 13:47:33 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 24728C2B9F for ; Wed, 11 Apr 2018 13:47:33 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.869 X-Spam-Level: * X-Spam-Status: No, score=1.869 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, T_DKIMWL_WL_MED=-0.01] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id zLRAysisjrVD for ; Wed, 11 Apr 2018 13:47:31 +0000 (UTC) Received: from mail-qk0-f182.google.com (mail-qk0-f182.google.com [209.85.220.182]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 885765FAD9 for ; Wed, 11 Apr 2018 13:47:31 +0000 (UTC) Received: by mail-qk0-f182.google.com with SMTP id s78so1851801qkl.8 for ; Wed, 11 Apr 2018 06:47:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=OzTldaYSKqtf830v4BqhLTi+hkHzaCa4RgRBN3tCVzg=; b=d23fhUabiQX9gEcgT45+oIjPVtUWLX/TJFYdmB0vriBIxm3U2hxanHqgdxoLbEKtYD uVMf4W0S+Y+TeP5Tmy20AFuXd3JgF4lXWWSRekLZdUy75HYeHOPThk5dXhIfbj79y/R7 7EwyN5TBqMMSKYJAPGxHyJ4lwNF6kHZbunGEHpzFNuOeOQdlJluLTUVAUvpTugVSMx/v C8Ym0j7u4XfRCrvuUs+CSYDdocqI4RkKov51+/+Gt/B3osr9X+Ft73laV+ONpXCT7lCT lrvPK0DLUjKdIsjrWBdOdRVPuak756tdBp7+yvX6bMmHfg1kTvHed3qTCgncJrTcflpd bwTg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=OzTldaYSKqtf830v4BqhLTi+hkHzaCa4RgRBN3tCVzg=; b=atFNatMqc5lnLDBblwbXKMZittsZXxRBHElMCZKS8oFr9MxdVv38lbknjN2CxMQBpg vhpTVVENVxAdxbpqujQkNgLnkPbxhtQAuNby52D4HQq58J3LurRBFcKCVjqM0TcaN9GM XX+Y4qfFFxS6nKuZjHTBvdT1mtijtHIrUPeZH/AGvd6lEgkdYebZ9KD7gpH1hyc20jgo 8BRkJNT02mjyAa+nS6yAwzDDieA21S5qzgCWEOMJSoHtcviER1xSwTwvgMd33z5CLMtw QqqphHzius9CcrH/zL+/FJwzMsidXR65OU8EbubL8e7ozNHiKIZ+/GYc3TBZHRZxoTPh 5uvQ== X-Gm-Message-State: ALQs6tAF0qZX0YjdINGmLz2UuOFbLH0dV3vKvOD8YzERw9LuWpoAui9U tcozZ4aGx5S58AsAxE+4KPE4nCq079p1Vg9ydv31ng== X-Google-Smtp-Source: AIpwx49k3wAQVYld0zUI268RxJPwRCYdc0rTVIAsZaqhB8lBiJK9FWuRJVlGJexY5b+AT4YZvoBA5/4ayg/7EW2q7MY= X-Received: by 10.55.103.215 with SMTP id b206mr7131704qkc.121.1523454450966; Wed, 11 Apr 2018 06:47:30 -0700 (PDT) MIME-Version: 1.0 Received: by 10.12.212.213 with HTTP; Wed, 11 Apr 2018 06:47:30 -0700 (PDT) In-Reply-To: <71506AE8-EFBA-41E3-ACCA-A3A004844FBA@uni-jena.de> References: <71506AE8-EFBA-41E3-ACCA-A3A004844FBA@uni-jena.de> From: Eddie Epstein Date: Wed, 11 Apr 2018 09:47:30 -0400 Message-ID: Subject: Re: DUCC and CAS Consumers To: user@uima.apache.org Content-Type: multipart/alternative; boundary="94eb2c05985461abad056992e13b" --94eb2c05985461abad056992e13b Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Erik, DUCC jobs can scale out user's components in two ways, horizontally by running multiple processes (process_deployments_max) and vertically by running the pipeline defined by the CM, AE and CC components in multiple threads (process_pipeline_count). Since the constructed top AAE is designed to run in multiple threads, it requires multiple deployments enabled for all pipeline components. The CM and CC components are optional as they could be already included in the specified process_descriptor_AE. The reason for explicitly specifying CM and CC components is to facilitate high scale out. The Job's collection reader should create CASes with references to data which will often be segmented by the CM into a collection of CASes to be processed by the users AE. The initial CAS created by the driver normally does not flow into the AE, but typically does flow to the CC after all child CASes from the CM have been processed to trigger the CC to finalize the collection. More information about the job model is described in the duccbook at https://uima.apache.org/d/uima-ducc-2.2.2/duccbook.html#x1-181000III Regards, Eddie On Wed, Apr 11, 2018 at 5:16 AM, Erik F=C3=A4=C3=9Fler wrote: > Hi all, > > I am doing my first steps with UIMA DUCC. I stumbled across the issue tha= t > my CAS consumer has allowMultipleDeployments=3Dfalse since it is supposed= to > write multiple CAS document texts into one large ZIP file. > DUCC complains about the discrepancy of the processing AAE being allowed > for multiple deployment but one of its containers (my consumer) is not. > I did specify the consumer with the "process_descriptor_CC=E2=80=9D job f= ile key > and was assuming that DUCC would take care of it. After all, it is a key = of > its own. But it seems the consumer is just wrapped into a new AAE togethe= r > with my annotator AAE. This new top AAE created by DUCC causes the error: > My own AAE is allowed for multiple deployment and so are its delegates. B= ut > the consumer not, of course. > > How to handle this case? The documentation of DUCC is rather vague at thi= s > point. There is the section about CAS consumer changes but it doesn=E2=80= =99t > mention multiple deployment explicitly. > > What is the =E2=80=9Cprocess_descriptor_CC=E2=80=9D for when it get wrapp= ed up into an AAE > with the user-delivered AAE anyway? > > Thanks and best regards, > > Erik > > --94eb2c05985461abad056992e13b--