airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Frank Cash (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AIRFLOW-3290) Issue when loading in UTF-8 into Postgres with pg_hook.copy_expert
Date Fri, 02 Nov 2018 13:42:00 GMT

     [ https://issues.apache.org/jira/browse/AIRFLOW-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Frank Cash updated AIRFLOW-3290:
--------------------------------
    Description: 
Problem:

 

Working on loading an ETL from mysql => postgres using both the mysql and postgres hook. 
I am working on moving utf-8 character set of usernames into my postgres store.  The file
is written as a UTF-8 file and thus it has a BOM header.  I would like to be able to define
the encoding that the open function passes in on [https://github.com/apache/incubator-airflow/blob/53b89b98371c7bb993b242c341d3941e9ce09f9a/airflow/hooks/postgres_hook.py#L63.] 
An example username would be `frank—cash ` with the dash being an em dash. 

> Issue when loading in UTF-8 into Postgres with pg_hook.copy_expert
> ------------------------------------------------------------------
>
>                 Key: AIRFLOW-3290
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3290
>             Project: Apache Airflow
>          Issue Type: Bug
>            Reporter: Frank Cash
>            Priority: Major
>
> Problem:
>  
> Working on loading an ETL from mysql => postgres using both the mysql and postgres
hook.  I am working on moving utf-8 character set of usernames into my postgres store. 
The file is written as a UTF-8 file and thus it has a BOM header.  I would like to be able
to define the encoding that the open function passes in on [https://github.com/apache/incubator-airflow/blob/53b89b98371c7bb993b242c341d3941e9ce09f9a/airflow/hooks/postgres_hook.py#L63.] 
An example username would be `frank—cash ` with the dash being an em dash. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message