Return-Path: X-Original-To: apmail-falcon-dev-archive@minotaur.apache.org Delivered-To: apmail-falcon-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 654D517C5E for ; Wed, 9 Sep 2015 05:34:04 +0000 (UTC) Received: (qmail 76128 invoked by uid 500); 9 Sep 2015 05:34:04 -0000 Delivered-To: apmail-falcon-dev-archive@falcon.apache.org Received: (qmail 76080 invoked by uid 500); 9 Sep 2015 05:34:04 -0000 Mailing-List: contact dev-help@falcon.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@falcon.apache.org Delivered-To: mailing list dev@falcon.apache.org Received: (qmail 76068 invoked by uid 99); 9 Sep 2015 05:34:04 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Sep 2015 05:34:04 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 8EFF3C01AB for ; Wed, 9 Sep 2015 05:34:03 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.899 X-Spam-Level: ** X-Spam-Status: No, score=2.899 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H2=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=yahoo.co.in Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id eBpBPXA1Jm7n for ; Wed, 9 Sep 2015 05:33:55 +0000 (UTC) Received: from nm39-vm8.bullet.mail.ne1.yahoo.com (nm39-vm8.bullet.mail.ne1.yahoo.com [98.138.229.168]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 7A2EE20382 for ; Wed, 9 Sep 2015 05:33:54 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.co.in; s=s2048; t=1441776827; bh=8R9KxuV1Tb2R9Jnz4IIIF3b37DM890wt0De5vdAtJoQ=; h=Date:From:Reply-To:To:In-Reply-To:References:Subject:From:Subject; b=U7VpU9nhYyrK+hwZ1FyxgGHO47sqrahhs1IE61kO0vSRkDt12y8G84U39VUEz/6vV67fJP+WlXDkqGo9RdKXej/hnWR/JREKXmiEzNUw6T9KoKm5D9WXLGz/5kmiMbT9Tm2RZok6KM0jOETSDfscHmnGQddcSX3nAvBDEIV4HtrWTVaIDhPNt1DUURZu7L9h4oQS6YiGgukhLlGpSwtYRC9ImkelpFCWiHkHbWIAZiInFusmb+hdkmdS/UPqqaTHZdSUL/EgibSG1r6/7NtxRiM6fmOHAzG7xJ1bFiBw481aE0jXQk4eJ2VwbKorbHmRXMDXIf97LWG3sVbfkTWd5w== Received: from [127.0.0.1] by nm39.bullet.mail.ne1.yahoo.com with NNFMP; 09 Sep 2015 05:33:47 -0000 Received: from [98.138.100.118] by nm39.bullet.mail.ne1.yahoo.com with NNFMP; 09 Sep 2015 05:30:47 -0000 Received: from [98.139.170.182] by tm109.bullet.mail.ne1.yahoo.com with NNFMP; 09 Sep 2015 05:30:47 -0000 Received: from [98.139.215.248] by tm25.bullet.mail.bf1.yahoo.com with NNFMP; 09 Sep 2015 05:30:47 -0000 Received: from [127.0.0.1] by omp1061.mail.bf1.yahoo.com with NNFMP; 09 Sep 2015 05:30:47 -0000 X-Yahoo-Newman-Property: ymail-4 X-Yahoo-Newman-Id: 139754.77516.bm@omp1061.mail.bf1.yahoo.com X-YMail-OSG: 6XueSDUVM1naY17FO7w0YHleVpV0QYtZIDVK0Cw0JLEhzrkaPc_ZG41HwSrft.s JJFxAzKFUUW6B0AFYabPpQHOzLoMwiXFUATzRyeu31w1CsxtYb4G6tbSmlsRN2RF.yalfOGvKfki 88iUtXdixESwGdmK4KlW7SjN1dUTT8sdytzXFY1Gr9unleotagVhlcGIeTh1NigB3JeLgmP9Woxv 8tKOTsM6HdtkSZu5GMR93PaPHnA7lfZ.hkFpB3ZcrcSPqiKneDcj0sIdvhBNKpQY07iRODMx7FrF 14ZTuFQeIwxgFo4SVrU0wubeDRgFJujUg3SGpWbMFbCpDvzpS7zAHr9MrZPKrazbd2ENtR6GiAHl VvrllAD8hd1gHditTod0pbUCHtaCYEyl9c.BvPxF1jR3EmVyt0fQYvo3kLdTAkKtsU6m3lfeW7fA zj0UChJ4B3O6xO.6APEKAuBL4fnaneA1ywChhh4mSXiHgizw7Ywe9wG.yJV0F1ThulWG4P4hpIrz yBhAHU634y9qAB2IfapYRiPPgwGx7f00.FYYz8s8Wm8gN7A-- Received: by 66.196.81.109; Wed, 09 Sep 2015 05:30:46 +0000 Date: Wed, 9 Sep 2015 05:30:46 +0000 (UTC) From: Peeyush Bishnoi Reply-To: Peeyush Bishnoi To: "dev@falcon.apache.org" Message-ID: <314314232.3595665.1441776646408.JavaMail.yahoo@mail.yahoo.com> In-Reply-To: References: Subject: Re: [DISCUSS] Lifecycle design closure MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_3595664_2117960891.1441776646402" ------=_Part_3595664_2117960891.1441776646402 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Ajay, Thanks for initiating the discussion. You have mentioned that Users can create new Lifecycle by extending it, so = it is like custom implementation=C2=A0using Lifecycle API. I am of the opin= ion Falcon should not be restarted for user custom implementation.=C2=A0 It is better to provide the way to the user to plug and use their custom Li= fecycle implementation to entities withoutrestarting Falcon server. If user contribute their implemented Lifecycle to Falcon, after thorough re= view, it should be made part of existing=C2=A0Falcon lifecycles to increase= the adoption. Thanks,---Peeyush=20 On Tuesday, 8 September 2015 11:57 PM, Ajay Yadav = wrote: =20 Hello everyone, During our previous sync up we discussed feed lifecycle. I have incorporated the suggestions in the updated design doc (attached). In this email I will try to answer the remaining unresolved questions. *Target Audience?* Falcon users are the people who write falcon processes and feeds and use Falcon CLI/ Rest API to maintain/operate them. Falcon developers are the people who work on enhancing falcon, regardless of the their decision to contribute it back to the Apache Falcon, though it is highly encouraged. Lifecycle extensions are meant for falcon developers to extend. Through the lifecycle feature we aim to provide clean extension points for extending feed management. It will be easier to understand falcon feed lifecycle with the analogy of oozie-el-extensions. *Is a restart of falcon required for adding a new lifecycle policy?* Yes, a restart is required. Lifecycle policies are applicable for all feeds in the falcon and we want addition of new lifecycle policies to be an explicit and authorised action. Moreover, addition of new policy for a lifecycle stage is a rare requirement and shouldn't be a hindrance in it's adoption. *Will lifecycle policies run as a separate process?* No. Execution of lifecycle policies happen outside of falcon. Some parts like preparing the workflows and validation are done inside falcon at the time of submission of a feed. Again with the analogy of oozie-el-extensions, this is an extension of falcon and is different from user submitted workflows/process definitions and running it in a separate JVM will be an overkill. I have attached the latest doc and xsd patch in the JIRA for your consideration. Would like to hear your thoughts. Once we have closure over design, I will work towards providing a complete patch for base framework. Cheers Ajay Yadava ------=_Part_3595664_2117960891.1441776646402--