airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Diego Rabatone Oliveira (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-1974) Make databricks operator more generic
Date Fri, 12 Jan 2018 18:39:00 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-1974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16324356#comment-16324356
] 

Diego Rabatone Oliveira commented on AIRFLOW-1974:
--------------------------------------------------

PR done: https://github.com/apache/incubator-airflow/pull/2932

> Make databricks operator more generic
> -------------------------------------
>
>                 Key: AIRFLOW-1974
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1974
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: hooks, operators
>    Affects Versions: 1.9.0
>            Reporter: Diego Rabatone Oliveira
>            Assignee: Diego Rabatone Oliveira
>
> For now, Databricks Operator only supports one Databricks API endpoint `` /jobs/runs/submit``.
> In order to be able to add support to new endpoints, we need a more generic Operator
(and Hook).
> After this issue is resolved, then other DataBricksOperators can be more easily added
to improve the Databricks API support.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message