Return-Path: X-Original-To: apmail-falcon-dev-archive@minotaur.apache.org Delivered-To: apmail-falcon-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7E15F18961 for ; Thu, 21 Jan 2016 09:23:42 +0000 (UTC) Received: (qmail 94563 invoked by uid 500); 21 Jan 2016 09:23:42 -0000 Delivered-To: apmail-falcon-dev-archive@falcon.apache.org Received: (qmail 94521 invoked by uid 500); 21 Jan 2016 09:23:42 -0000 Mailing-List: contact dev-help@falcon.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@falcon.apache.org Delivered-To: mailing list dev@falcon.apache.org Received: (qmail 94509 invoked by uid 99); 21 Jan 2016 09:23:42 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 21 Jan 2016 09:23:42 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id F0DE01A0699 for ; Thu, 21 Jan 2016 09:23:41 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.426 X-Spam-Level: X-Spam-Status: No, score=0.426 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.554] autolearn=disabled Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id qje_xUO4JJGQ for ; Thu, 21 Jan 2016 09:23:41 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with SMTP id A209B21195 for ; Thu, 21 Jan 2016 09:23:40 +0000 (UTC) Received: (qmail 94431 invoked by uid 99); 21 Jan 2016 09:23:39 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 21 Jan 2016 09:23:39 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id D1A8D2C1F58 for ; Thu, 21 Jan 2016 09:23:39 +0000 (UTC) Date: Thu, 21 Jan 2016 09:23:39 +0000 (UTC) From: "Peeyush Bishnoi (JIRA)" To: dev@falcon.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Assigned] (FALCON-1763) Create a spark execution engine for Falcon MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/FALCON-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peeyush Bishnoi reassigned FALCON-1763: --------------------------------------- Assignee: Peeyush Bishnoi > Create a spark execution engine for Falcon > ------------------------------------------ > > Key: FALCON-1763 > URL: https://issues.apache.org/jira/browse/FALCON-1763 > Project: Falcon > Issue Type: Bug > Reporter: Venkat Ranganathan > Assignee: Peeyush Bishnoi > > It would be great to get a spark execution engine for Falcon along with the existing Oozie wf, Pig and Hive support. This will greatly help in easing the use of Spark jobs to use with Falcon data management. > We should make sure that this support works with all Falcon deployment modes (embedded, distributed, secure, non secure) and also diffrenent Spark application modes(standalone, yarn client, yarn standalone etc) -- This message was sent by Atlassian JIRA (v6.3.4#6332)