airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-1726) Copy Expert command for Postgres Hook
Date Thu, 19 Oct 2017 18:53:00 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16211542#comment-16211542
] 

ASF subversion and git services commented on AIRFLOW-1726:
----------------------------------------------------------

Commit 8a4ad30104d9e05589167ec0cde53ad941b9a1f7 in incubator-airflow's branch refs/heads/v1-9-test
from [~andyxhadji]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=8a4ad30 ]

[AIRFLOW-1726] Add copy_expert psycopg2 method to PostgresHook

Executes SQL using psycopg2 copy_expert method
Necessary to execute COPY command without access to a superuser

Closes #2698 from andyxhadji/AIRFLOW-1726

(cherry picked from commit 6372770be6aab67654cede81d6b027a838077a8a)
Signed-off-by: Bolke de Bruin <bolke@xs4all.nl>


> Copy Expert command for Postgres Hook
> -------------------------------------
>
>                 Key: AIRFLOW-1726
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1726
>             Project: Apache Airflow
>          Issue Type: Improvement
>            Reporter: Andy Hadjigeorgiou
>            Assignee: Andy Hadjigeorgiou
>            Priority: Minor
>             Fix For: 1.9.0
>
>
> The Copy command is useful for postgres users, and it's client-based version "\COPY"
can be frustrating to use due to python escape character shenanigans. Fortunately, psycopg2
supports a copy_expert method that simplifies the command and it's options, so I think it
would be a useful addition to the PostgresHook.
> I'm working on the PR now, will post here when complete.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message