Return-Path: X-Original-To: apmail-falcon-dev-archive@minotaur.apache.org Delivered-To: apmail-falcon-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BF49310263 for ; Sun, 2 Mar 2014 03:33:46 +0000 (UTC) Received: (qmail 17168 invoked by uid 500); 2 Mar 2014 03:33:45 -0000 Delivered-To: apmail-falcon-dev-archive@falcon.apache.org Received: (qmail 17084 invoked by uid 500); 2 Mar 2014 03:33:43 -0000 Mailing-List: contact dev-help@falcon.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@falcon.incubator.apache.org Delivered-To: mailing list dev@falcon.incubator.apache.org Received: (qmail 17076 invoked by uid 99); 2 Mar 2014 03:33:41 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 02 Mar 2014 03:33:41 +0000 X-ASF-Spam-Status: No, hits=-2000.5 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Sun, 02 Mar 2014 03:33:40 +0000 Received: (qmail 17065 invoked by uid 99); 2 Mar 2014 03:33:19 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 02 Mar 2014 03:33:19 +0000 Date: Sun, 2 Mar 2014 03:33:19 +0000 (UTC) From: "Venkatesh Seetharam (JIRA)" To: dev@falcon.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (FALCON-327) Simplify message passing framework MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Venkatesh Seetharam created FALCON-327: ------------------------------------------ Summary: Simplify message passing framework Key: FALCON-327 URL: https://issues.apache.org/jira/browse/FALCON-327 Project: Falcon Issue Type: Improvement Components: messaging Affects Versions: 0.5 Reporter: Venkatesh Seetharam Issues with the current implementation: * hard to evolve the schema If I need to add one attribute, requires change in various places * Too many enum classes for the same variable Confuses the heck out of me. Some small, some caps * FalconPostProcessing gets args, parses the args into CLI and converts 'em back into args repeatedly Too much redundant processing * Timestamp should be long as opposed to a String - minor? I need to compare dates and thought long is easier instead of constructing expensive SimpleDateFormats * Hard dependency on JMS. Suggest the following: * Have the payload in a Map serialized as JSON - wonder how to pass this from oozie * Have one central Enum class for the keys in the payload * Each class now depends on this Enum and takes what it needs from the Map We also could rethink about the current messaging which falcon relies on (had started a discuss thread but did not get any response): * Continue to use JMS * Switch to FS Polling * Use both Thoughts? -- This message was sent by Atlassian JIRA (v6.1.5#6160)