airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (Jira)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-3783) Switch to HEADER arg to unload data from Redshift to S3
Date Fri, 11 Oct 2019 14:28:00 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-3783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949503#comment-16949503
] 

ASF GitHub Bot commented on AIRFLOW-3783:
-----------------------------------------

feluelle commented on pull request #4610: [AIRFLOW-3783] Switch to HEADER option being provided
already by Redshift
URL: https://github.com/apache/airflow/pull/4610
 
 
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Switch to HEADER arg to unload data from Redshift to S3
> -------------------------------------------------------
>
>                 Key: AIRFLOW-3783
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3783
>             Project: Apache Airflow
>          Issue Type: Improvement
>            Reporter: Shreya Chakraborty
>            Assignee: Felix Uellendall
>            Priority: Major
>
> Redshift has added a new *HEADER* option to the s3unload parameters.
> So we can remove the default PARALLEL OFF in the existing
> RedshiftToS3Transfer operator. The unload operation can now run parallely, hence faster,
along with headers, if required.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message