airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kaxil Naik (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-3266) AWS Athena Operator in Airflow
Date Sun, 02 Dec 2018 11:46:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Kaxil Naik updated AIRFLOW-3266:
--------------------------------
    Fix Version/s:     (was: 2.0.0)
                   1.10.2

> AWS Athena Operator in Airflow
> ------------------------------
>
>                 Key: AIRFLOW-3266
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3266
>             Project: Apache Airflow
>          Issue Type: New Feature
>          Components: aws
>    Affects Versions: 1.10.0
>            Reporter: Sai Phanindhra
>            Assignee: Sai Phanindhra
>            Priority: Minor
>             Fix For: 1.10.2
>
>
> There is no official athena operator as of now airflow. Either one has do it using boto3
in python operator or using aws cli in bash operator. Either of these does not take care of
total life cycle of query. Create a Athena operator and hook to submit presto query and update
task based of state of submitted query.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message