spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yash Datta (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (SPARK-5948) Support writing to partitioned table for the Parquet data source
Date Tue, 29 Dec 2015 10:18:49 GMT

    [ https://issues.apache.org/jira/browse/SPARK-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073755#comment-15073755
] 

Yash Datta edited comment on SPARK-5948 at 12/29/15 10:18 AM:
--------------------------------------------------------------

oh i see, 
So does it mean that when using hive commands that use dynamic partitioning like :

insert overwrite table <tablename> partition (a, b)
select * from <sourcetable> 


spark will use this modified path ?

Thanks for the prompt reply


was (Author: saucam):
oh i see, 
So does it mean that when using hive commands that use dynamic partitioning like :

insert verwrite table <tablename> partition (a, b)
select * from <sourcetable> 


spark will use this modified path ?

Thanks for the prompt reply

> Support writing to partitioned table for the Parquet data source
> ----------------------------------------------------------------
>
>                 Key: SPARK-5948
>                 URL: https://issues.apache.org/jira/browse/SPARK-5948
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>            Reporter: Cheng Lian
>            Assignee: Michael Armbrust
>            Priority: Blocker
>             Fix For: 1.4.0
>
>
> In 1.3.0, we added support for reading partitioned tables declared in Hive metastore
for the Parquet data source. However, writing to partitioned tables is not supported yet.
This feature should probably built upon SPARK-5947.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message