Return-Path: X-Original-To: apmail-falcon-dev-archive@minotaur.apache.org Delivered-To: apmail-falcon-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D5A501808B for ; Wed, 25 Nov 2015 06:33:44 +0000 (UTC) Received: (qmail 44172 invoked by uid 500); 25 Nov 2015 06:33:44 -0000 Delivered-To: apmail-falcon-dev-archive@falcon.apache.org Received: (qmail 44125 invoked by uid 500); 25 Nov 2015 06:33:44 -0000 Mailing-List: contact dev-help@falcon.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@falcon.apache.org Delivered-To: mailing list dev@falcon.apache.org Received: (qmail 44114 invoked by uid 99); 25 Nov 2015 06:33:44 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 25 Nov 2015 06:33:44 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 13A9EC0F3F for ; Wed, 25 Nov 2015 06:33:44 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.427 X-Spam-Level: *** X-Spam-Status: No, score=3.427 tagged_above=-999 required=6.31 tests=[HEADER_FROM_DIFFERENT_DOMAINS=0.001, HTML_MESSAGE=3, KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.554] autolearn=disabled Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id YiRV7-SQhKBV for ; Wed, 25 Nov 2015 06:33:42 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with SMTP id A57D22064F for ; Wed, 25 Nov 2015 06:33:41 +0000 (UTC) Received: (qmail 44097 invoked by uid 99); 25 Nov 2015 06:33:40 -0000 Received: from reviews-vm.apache.org (HELO reviews.apache.org) (140.211.11.40) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 25 Nov 2015 06:33:40 +0000 Received: from reviews.apache.org (localhost [127.0.0.1]) by reviews.apache.org (Postfix) with ESMTP id 5F0DE2E3B04; Wed, 25 Nov 2015 06:33:39 +0000 (UTC) Content-Type: multipart/alternative; boundary="===============6331999026867020292==" MIME-Version: 1.0 Subject: Re: Review Request 39844: FALCON-1233 Support co-existence of Oozie scheduler (coord) and Falcon native scheduler. From: "Pallavi Rao" To: "Peeyush Bishnoi" , "Falcon" , "Pallavi Rao" Date: Wed, 25 Nov 2015 06:33:39 -0000 Message-ID: <20151125063339.24387.8152@reviews.apache.org> X-ReviewBoard-URL: https://reviews.apache.org/ Auto-Submitted: auto-generated Sender: "Pallavi Rao" X-ReviewGroup: Falcon X-Auto-Response-Suppress: DR, RN, OOF, AutoReply X-ReviewRequest-URL: https://reviews.apache.org/r/39844/ X-Sender: "Pallavi Rao" References: <20151120065343.1027.75437@reviews.apache.org> In-Reply-To: <20151120065343.1027.75437@reviews.apache.org> Reply-To: "Pallavi Rao" X-ReviewRequest-Repository: falcon-git --===============6331999026867020292== MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit > On Nov. 20, 2015, 6:53 a.m., Peeyush Bishnoi wrote: > > common/src/main/java/org/apache/falcon/workflow/WorkflowEngineFactory.java, line 46 > > > > > > Any particular reason for naming WF Engine PRIMARY and SECONDARY. Yep. confusing. Addressed in the new patch. - Pallavi ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/39844/#review107316 ----------------------------------------------------------- On Nov. 25, 2015, 6:32 a.m., Pallavi Rao wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/39844/ > ----------------------------------------------------------- > > (Updated Nov. 25, 2015, 6:32 a.m.) > > > Review request for Falcon. > > > Bugs: FALCON-1233 > https://issues.apache.org/jira/browse/FALCON-1233 > > > Repository: falcon-git > > > Description > ------- > > The migration to Falcon native scheduler should be as seamless as possible and the user should be able to migrate to the native scheduler in a phased manner (entity by entity). > > This patch introduces the notion of primary and secondary workflow engines. It allows users to schedule an entity on the secondary engine (primary, by default). The idea is that initially, users will use Falcon native scheduler as the secondary engine to migrate their entities one by one. When most entities have been migrated, the Oozie scheduler becomes secondary (and eventually removed). > > > Diffs > ----- > > common/src/main/java/org/apache/falcon/workflow/WorkflowEngineFactory.java 49592ac > common/src/main/java/org/apache/falcon/workflow/WorkflowJobEndNotificationService.java 9d96fa3 > common/src/main/java/org/apache/falcon/workflow/engine/AbstractWorkflowEngine.java 7b36b11 > docs/src/site/twiki/falconcli/Schedule.twiki 42192c7 > oozie/src/main/java/org/apache/falcon/workflow/engine/OozieWorkflowEngine.java 724f646 > prism/src/main/java/org/apache/falcon/resource/AbstractEntityManager.java 16ef83a > prism/src/main/java/org/apache/falcon/resource/AbstractInstanceManager.java fea2989 > prism/src/main/java/org/apache/falcon/resource/AbstractSchedulableEntityManager.java d317aa1 > scheduler/src/main/java/org/apache/falcon/workflow/engine/FalconWorkflowEngine.java d7d157f > scheduler/src/main/java/org/apache/falcon/workflow/engine/OozieDAGEngine.java ca2010b > scheduler/src/test/java/org/apache/falcon/execution/FalconExecutionServiceTest.java bff92c9 > scheduler/src/test/java/org/apache/falcon/workflow/engine/WorkflowEngineFactoryTest.java PRE-CREATION > unit/pom.xml 8d9f443 > > Diff: https://reviews.apache.org/r/39844/diff/ > > > Testing > ------- > > UTs added. Manual testing done. > > > Thanks, > > Pallavi Rao > > --===============6331999026867020292==--