airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-729) Google Dataproc cluster creation operator
Date Tue, 10 Jan 2017 08:15:58 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814290#comment-15814290
] 

ASF subversion and git services commented on AIRFLOW-729:
---------------------------------------------------------

Commit ffbe7282dcff5d5dd1c23ab0eff27dab2bd457f6 in incubator-airflow's branch refs/heads/v1-8-test
from [~bodschut]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=ffbe728 ]

[AIRFLOW-729] Add Google Cloud Dataproc cluster creation operator

The operator checks if there is already a cluster
running with the provided name in the provided
project.
If so, the operator finishes successfully.
Otherwise, the operator issues a rest API call to
initiate
the cluster creation and waits until the creation
is successful before exiting.

Closes #1971 from
bodschut/feature/dataproc_operator


> Google Dataproc cluster creation operator
> -----------------------------------------
>
>                 Key: AIRFLOW-729
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-729
>             Project: Apache Airflow
>          Issue Type: New Feature
>          Components: gcp, operators
>            Reporter: Bob De Schutter
>            Assignee: Bob De Schutter
>             Fix For: Airflow 1.8
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> Add an operator that creates a Google Cloud Dataproc cluster.
> The operator checks if there is already a cluster running with the provided name in the
provided project. If so, the operator finishes successfully. Otherwise, the operator issues
a rest API call to initiate the cluster creation and waits until the creation is successful
before exiting.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message