airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <>
Subject [jira] [Commented] (AIRFLOW-23) Support Google cloud DataProc in Airflow
Date Tue, 31 May 2016 16:59:13 GMT


ASF subversion and git services commented on AIRFLOW-23:

Commit 0a5364cd430a024ed9be4e5b2b5d5174c1b98497 in incubator-airflow's branch refs/heads/master
from [~alexvanboxel]
[;h=0a5364c ]

[AIRFLOW-23] Support for Google Cloud DataProc

Dear Airflow Maintainers,

Please accept this PR that addresses the following issues:

Spark, Hadoop, PySpart, SparkSQL, Pig an Hive support of DataProc cluster

Author: Alex Van Boxel <>

Closes #1532 from alexvanboxel/AIRFLOW-23.

> Support Google cloud DataProc in Airflow
> ----------------------------------------
>                 Key: AIRFLOW-23
>                 URL:
>             Project: Apache Airflow
>          Issue Type: New Feature
>          Components: gcp
>            Reporter: Chris Riccomini
>            Assignee: Alex Van Boxel
>              Labels: gcp
> It would be useful to be able to interact with [Google cloud DataProc|]
clusters from Airflow. We should add the proper hooks/operators to do this.

This message was sent by Atlassian JIRA

View raw message