airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alex Johnson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-2797) Add ability to create Google Dataproc cluster with custom image
Date Wed, 05 Sep 2018 02:03:00 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16603822#comment-16603822
] 

Alex Johnson commented on AIRFLOW-2797:
---------------------------------------

[~exploy]: I'd be very much interested in this.

> Add ability to create Google Dataproc cluster with custom image
> ---------------------------------------------------------------
>
>                 Key: AIRFLOW-2797
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2797
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: contrib, gcp, operators
>    Affects Versions: 2.0.0
>            Reporter: Jarosław Śmietanka
>            Assignee: Jarosław Śmietanka
>            Priority: Minor
>
> In GCP, it is possible to create Dataproc cluster with a [custom image|https://cloud.google.com/dataproc/docs/guides/dataproc-images]
that includes user's pre-installed packages. It significantly reduces the startup time of
the cluster.
>  
> Since I already have a code which does that, I volunteer to bring it to the community :)  
> This improvement won't change many components and should not require groundbreaking
changes to DataprocClusterCreateOperator.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message