spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wenchen Fan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-16032) Audit semantics of various insertion operations related to partitioned tables
Date Tue, 21 Jun 2016 23:33:57 GMT

    [ https://issues.apache.org/jira/browse/SPARK-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15343036#comment-15343036
] 

Wenchen Fan commented on SPARK-16032:
-------------------------------------

[~rdblue] I think the biggest problem is we don't have by-name insertion for hive table now.
 Although this feature is not in 1.6, but we do have it before the recent commits by us. 
Does it make more sense to support hive table in `DataFrameWriter.saveAsTable` before 2.0?

> Audit semantics of various insertion operations related to partitioned tables
> -----------------------------------------------------------------------------
>
>                 Key: SPARK-16032
>                 URL: https://issues.apache.org/jira/browse/SPARK-16032
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 2.0.0
>            Reporter: Cheng Lian
>            Assignee: Wenchen Fan
>            Priority: Critical
>         Attachments: [SPARK-16032] Spark SQL table insertion auditing - Google Docs.pdf
>
>
> We found that semantics of various insertion operations related to partition tables can
be inconsistent. This is an umbrella ticket for all related tickets.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message