airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daryl Erwin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-1506) Improve DataprocClusterCreateOperator
Date Fri, 25 Aug 2017 17:08:00 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16141894#comment-16141894
] 

Daryl Erwin commented on AIRFLOW-1506:
--------------------------------------

This appears to be needed to be able to enable the sql-admin scope to allow access to the
sql-cloud-proxy from the dataproc cluster.

> Improve DataprocClusterCreateOperator
> -------------------------------------
>
>                 Key: AIRFLOW-1506
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1506
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: contrib, operators
>            Reporter: Yu Ishikawa
>
> h2. Goals
> {{DataprocClusterCreateOperator}} should support {{$. gceClusterConfig.serviceAccountScopes}}
to specify scopes for a Dataproc cluster.
> For example, I guess some users would like to store the result to Google Datastore and
like this. In such a case, we have to put additional scopes to access to the produces from
the Dataproc cluster.
> https://cloud.google.com/dataproc/docs/reference/rest/v1/projects.regions.clusters#gceclusterconfig



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message