Return-Path: X-Original-To: apmail-falcon-dev-archive@minotaur.apache.org Delivered-To: apmail-falcon-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0D7B9181B2 for ; Fri, 5 Feb 2016 00:49:42 +0000 (UTC) Received: (qmail 53573 invoked by uid 500); 5 Feb 2016 00:49:42 -0000 Delivered-To: apmail-falcon-dev-archive@falcon.apache.org Received: (qmail 53532 invoked by uid 500); 5 Feb 2016 00:49:41 -0000 Mailing-List: contact dev-help@falcon.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@falcon.apache.org Delivered-To: mailing list dev@falcon.apache.org Received: (qmail 53521 invoked by uid 99); 5 Feb 2016 00:49:41 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 05 Feb 2016 00:49:41 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 8495FC0BE4 for ; Fri, 5 Feb 2016 00:49:41 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -3.649 X-Spam-Level: X-Spam-Status: No, score=-3.649 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.429] autolearn=disabled Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id sTE4w_FLdbiW for ; Fri, 5 Feb 2016 00:49:41 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with SMTP id BE6E420D37 for ; Fri, 5 Feb 2016 00:49:40 +0000 (UTC) Received: (qmail 52524 invoked by uid 99); 5 Feb 2016 00:49:40 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 05 Feb 2016 00:49:40 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id F23B22C1F6B for ; Fri, 5 Feb 2016 00:49:39 +0000 (UTC) Date: Fri, 5 Feb 2016 00:49:39 +0000 (UTC) From: "Ying Zheng (JIRA)" To: dev@falcon.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Comment Edited] (FALCON-1627) Provider integration with Azure Data Factory pipelines MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/FALCON-1627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15133302#comment-15133302 ] Ying Zheng edited comment on FALCON-1627 at 2/5/16 12:49 AM: ------------------------------------------------------------- [~ajayyadava]: Created pull request: https://github.com/apache/falcon/pull/27 Due to the dependencies between sub-tasks, consolidated our work into one patch, per discussion with Venkat and Sowmya. was (Author: yzheng-hortonworks): [~ajayyadava]: Created pull request: https://github.com/apache/falcon/pull/27 Due to the dependencies between sub-tasks, consolidated our work into one patch. > Provider integration with Azure Data Factory pipelines > ------------------------------------------------------ > > Key: FALCON-1627 > URL: https://issues.apache.org/jira/browse/FALCON-1627 > Project: Falcon > Issue Type: New Feature > Affects Versions: 0.8 > Reporter: Venkat Ranganathan > Assignee: Ying Zheng > Fix For: trunk > > Attachments: ADF JSON Message Definition.pdf, ADFTutorial.pdf, FALCON-1627.patch > > > Micrsosoft Azure Data Factory is Data processing service available on Microsoft Azure environment which allows users to compose, orchestrate and manage data pipelines somewhat similar to Falcon on the azure environment. > The integration will allow ADF to invoke a Falcon activity (replication, hive or pig proessing work) from the Azure Data Factory data pipeline so that Azure cloud and Hadoop onprem processing can be realized. > The integration work has a few steps and will also be enhanced when ADF V3 protocol is introduced -- This message was sent by Atlassian JIRA (v6.3.4#6332)