airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-561) Redshift to S3 Operator
Date Mon, 14 Nov 2016 07:10:58 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15663009#comment-15663009
] 

ASF subversion and git services commented on AIRFLOW-561:
---------------------------------------------------------

Commit f8f7d1af20ae928f0375a211913aa1abc9cb2044 in incubator-airflow's branch refs/heads/master
from [~jackar]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=f8f7d1a ]

[AIRFLOW-561] Add RedshiftToS3Transfer operator

Add a redshift operator to unload tables from redshift into a single CSV in s3 with headers

Closes #1831 from jackar/redshift-to-s3-csv


> Redshift to S3 Operator
> -----------------------
>
>                 Key: AIRFLOW-561
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-561
>             Project: Apache Airflow
>          Issue Type: Bug
>            Reporter: Jack Arenas
>            Assignee: Jack Arenas
>
> We want a generic way to specify a table and 'UNLOAD' it into S3 as a single CSV file
with headers. I've run into this problem several times and I figured I could bake it into
Airflow because I think others would also find it useful.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message