spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yin Huai (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-14507) Decide if we should still support CREATE EXTERNAL TABLE AS SELECT
Date Tue, 31 May 2016 20:42:12 GMT

    [ https://issues.apache.org/jira/browse/SPARK-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15308585#comment-15308585
] 

Yin Huai commented on SPARK-14507:
----------------------------------

chatted with [~andrewor14]. Since https://github.com/apache/spark/pull/13386/files (SPARK-15646)
will fix the location handling when convertCTAS is true, probably it is not really needed
to ban EXTERNAL keyword (also, hive's syntax supports external for a regular create table
command). 

> Decide if we should still support CREATE EXTERNAL TABLE AS SELECT
> -----------------------------------------------------------------
>
>                 Key: SPARK-14507
>                 URL: https://issues.apache.org/jira/browse/SPARK-14507
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>            Reporter: Yin Huai
>            Assignee: Yin Huai
>            Priority: Critical
>
> Look like we support CREATE EXTERNAL TABLE AS SELECT by accident. Should we still support
it? Seems Hive does not support it. Based on the doc Impala, seems Impala supports it. Right
now, seems the rule of CreateTables in HiveMetastoreCatalog.scala does not respect EXTERNAL
keyword when {{hive.convertCTAS}} is true and the CTAS query does not provide any storage
format. For this case, the table will become a MANAGED_TABLE and stored in the default metastore
location (not the user specified location). 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message