airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ali Uz (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AIRFLOW-918) Improve bulk_load function for MySqlHook
Date Sun, 26 Feb 2017 19:41:45 GMT
Ali Uz created AIRFLOW-918:
------------------------------

             Summary: Improve bulk_load function for MySqlHook
                 Key: AIRFLOW-918
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-918
             Project: Apache Airflow
          Issue Type: Improvement
          Components: hooks
    Affects Versions: Airflow 1.7.1.3
            Reporter: Ali Uz
            Priority: Minor


I think we can improve the `bulk_load` function in MySqlHook by adding a few more parameters.
For example, if I want to run a LOAD DATA command like the following:

```
LOAD DATA LOCAL INFILE 'abc.csv' INTO TABLE abc
FIELDS TERMINATED BY ',' 
ENCLOSED BY '"' 
LINES TERMINATED BY '\r\n'
IGNORE 1 LINES
```

I would expect to supply the delimiter parameters, enclosing quotes parameter, line terminating
parameter and ignore line number parameter.
The current function only applies the following command:

```
LOAD DATA LOCAL INFILE 'abc.csv' INTO TABLE abc
```

It would be great if we could extend it.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message