airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-23) Support Google cloud DataProc in Airflow
Date Tue, 31 May 2016 16:59:13 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-23?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15308111#comment-15308111
] 

ASF subversion and git services commented on AIRFLOW-23:
--------------------------------------------------------

Commit 0a5364cd430a024ed9be4e5b2b5d5174c1b98497 in incubator-airflow's branch refs/heads/master
from [~alexvanboxel]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=0a5364c ]

[AIRFLOW-23] Support for Google Cloud DataProc

Dear Airflow Maintainers,

Please accept this PR that addresses the following issues:
- AIRFLOW-23

Spark, Hadoop, PySpart, SparkSQL, Pig an Hive support of DataProc cluster

Author: Alex Van Boxel <alex@vanboxel.be>

Closes #1532 from alexvanboxel/AIRFLOW-23.


> Support Google cloud DataProc in Airflow
> ----------------------------------------
>
>                 Key: AIRFLOW-23
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-23
>             Project: Apache Airflow
>          Issue Type: New Feature
>          Components: gcp
>            Reporter: Chris Riccomini
>            Assignee: Alex Van Boxel
>              Labels: gcp
>
> It would be useful to be able to interact with [Google cloud DataProc|https://cloud.google.com/dataproc/]
clusters from Airflow. We should add the proper hooks/operators to do this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message