Return-Path: X-Original-To: apmail-apex-dev-archive@minotaur.apache.org Delivered-To: apmail-apex-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 321FE18C81 for ; Mon, 4 Jan 2016 17:01:43 +0000 (UTC) Received: (qmail 4374 invoked by uid 500); 4 Jan 2016 17:01:43 -0000 Delivered-To: apmail-apex-dev-archive@apex.apache.org Received: (qmail 4318 invoked by uid 500); 4 Jan 2016 17:01:43 -0000 Mailing-List: contact dev-help@apex.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@apex.incubator.apache.org Delivered-To: mailing list dev@apex.incubator.apache.org Received: (qmail 4302 invoked by uid 99); 4 Jan 2016 17:01:42 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Jan 2016 17:01:42 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 2940A1A1199 for ; Mon, 4 Jan 2016 17:01:42 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.145 X-Spam-Level: X-Spam-Status: No, score=0.145 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.554, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=capitalone.com Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id h6fAvqg3JzJx for ; Mon, 4 Jan 2016 17:01:32 +0000 (UTC) Received: from vomail01.capitalone.com (outv.capitalone.com [204.63.44.201]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id D476A20265 for ; Mon, 4 Jan 2016 17:01:31 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=capitalone.com; l=2799; q=dns/txt; s=SM2048Mar2015P; t=1451926892; x=1452013292; h=from:to:date:subject:message-id:references:in-reply-to: mime-version:content-transfer-encoding; bh=CvLLiqfqBwft+VzTcSgJPmCLZ7KkyjM2/foo+psW9y4=; b=SuIA5GBPUcG/RSJzDyEik0pl+mJUGihg2dDFfVFFEuETpcpo9r/0Ud/3 3sYEIsmxo2Fy7rhsbysGGB1z67Tyyw6jliVDixOhmpbZovGFAI2EZW1jB hZWBpudVjgdnh6y3YCyk9/8PRjcbiQ2VaENxSZAA853qi6Em4UkQ+eybZ M0U++O6IXtzHKbdtMpWpYi7T4irrGsNuH7rywmFJVe3Ib321+3ulWkyv7 KsnWCU4jWWwgGz0V7z4GhvaLUHzzSRcqvhnSCNcYuGMZjLgny4eSGZIQK TyjFfpisQHXA1TdMLKqnof3rSwJ/S2DUWA99VFN+SvWkLqhjRMhOkUg3R w==; X-IronPort-AV: E=McAfee;i="5700,7163,8033"; a="14254320" X-IronPort-AV: E=Sophos;i="5.20,521,1444708800"; d="scan'208";a="14254320" X-AFNotificationDomain: TRUE Received: from kdcpexcasht03.cof.ds.capitalone.com ([10.37.194.13]) by vomail01.kdc.capitalone.com with ESMTP/TLS/AES128-SHA; 04 Jan 2016 12:01:22 -0500 Received: from KDCPEXCMB01.cof.ds.capitalone.com ([169.254.1.72]) by kdcpexcasht03.cof.ds.capitalone.com ([10.37.194.13]) with mapi; Mon, 4 Jan 2016 12:01:14 -0500 From: "Frew, Troy" To: "dev@apex.incubator.apache.org" Date: Mon, 4 Jan 2016 12:01:13 -0500 Subject: Re: [jira] [Updated] (APEXCORE-3) Ability for an operator to populate DAG at launch time Thread-Topic: [jira] [Updated] (APEXCORE-3) Ability for an operator to populate DAG at launch time Thread-Index: AdFHEYTtrr5oj8//SG+HXFH7mhEKIQ== Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/14.5.7.151005 acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Unsubscribe Troy Frew 703.728.4309 Lead Systems Integrator Troy.Frew@capitalone.com On 12/29/15, 6:44 PM, "Sasha Parfenov (JIRA)" wrote: > > [ = >https://issues.apache.org/jira/browse/APEXCORE-3?page=3Dcom.atlassian.jira= .p >lugin.system.issuetabpanels:all-tabpanel ] > >Sasha Parfenov updated APEXCORE-3: >---------------------------------- > Labels: roadmap (was: ) > >> Ability for an operator to populate DAG at launch time >> ------------------------------------------------------ >> >> Key: APEXCORE-3 >> URL: https://issues.apache.org/jira/browse/APEXCORE-3 >> Project: Apache Apex Core >> Issue Type: New Feature >> Reporter: Amol Kekre >> Assignee: Vlad Rozov >> Priority: Critical >> Labels: roadmap >> Fix For: 3.3.0 >> >> >> Apex should have an operator API that lets the operator generate DAG >>during launch time. This will mean the following >> - Logical DAG will have one operator. This is the operator that will >>generate a DAG underneath >> - Physical plan will have the DAG generated by the operator >> - Execution plan will mimic physical plan + container location etc. >> For example lets say we have three operators in a DAG (app) A->B->C >> B during launch time generates a DAG B1->B2->B3, then the physical plan >>will be >> A->B1->B2->B3->C >> This should work irrespective of number of ports, etc. A typical >>flattening. The operators inside of B (B1, B2, B3) should have >>properties and attributes just as any. Users should be able to access >>these at run time and compile time. B itself should support properties >>and attributes that B1, B2, B3 can inherit from. >> This is a very critical feature as it will open up users to plug-in >>their own engines and still take up complete operability support from >>Apex engine. > > > >-- >This message was sent by Atlassian JIRA >(v6.3.4#6332) ________________________________________________________ The information contained in this e-mail is confidential and/or proprietary= to Capital One and/or its affiliates and may only be used solely in perfor= mance of work or services for Capital One. The information transmitted here= with is intended only for use by the individual or entity to which it is ad= dressed. If the reader of this message is not the intended recipient, you a= re hereby notified that any review, retransmission, dissemination, distribu= tion, copying or other use of, or taking of any action in reliance upon thi= s information is strictly prohibited. If you have received this communicati= on in error, please contact the sender and delete the material from your co= mputer.