spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <>
Subject [jira] [Commented] (SPARK-16463) Support `truncate` option in Overwrite mode for JDBC DataFrameWriter
Date Sat, 09 Jul 2016 19:34:10 GMT


Apache Spark commented on SPARK-16463:

User 'dongjoon-hyun' has created a pull request for this issue:

>  Support `truncate` option in Overwrite mode for JDBC DataFrameWriter
> ---------------------------------------------------------------------
>                 Key: SPARK-16463
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>            Reporter: Dongjoon Hyun
>            Priority: Minor
> This issue adds a boolean option, `truncate`, for SaveMode.Overwrite of JDBC DataFrameWriter.
If this option is `true`, it use `TRUNCATE TABLE` instead of `DROP TABLE`.
> - Without CREATE/DROP privilege, we can save dataframe to database. Sometime these are
not allowed for security.
> - It will keep the existing table information, so users can add and keep some additional
CONSTRAINTs for the table.
> - Sometime, TRUNCATE is faster than the combination of DROP/CREATE.
> This issue is different from SPARK-16410 which aims to use `TRUNCATE` only for JDBC sources.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message