spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Armbrust (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-2825) Allow creating external tables in metastore
Date Mon, 04 Aug 2014 21:28:12 GMT

    [ https://issues.apache.org/jira/browse/SPARK-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085311#comment-14085311
] 

Michael Armbrust commented on SPARK-2825:
-----------------------------------------

CREATE EXTERNAL TABLE already works as far as I know and should have the same semantics as
Hive.

The only operation that is not supported is CREATE EXTERNAL TABLE tablename AS SELECT ...
This operation is heavier weight than just creating a pointer, since the query needs to be
executed to calculate the data.  I'd assume that this is for a case when you want to create
a new table, but want the data to exist outside of warehouse.

> Allow creating external tables in metastore
> -------------------------------------------
>
>                 Key: SPARK-2825
>                 URL: https://issues.apache.org/jira/browse/SPARK-2825
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>            Reporter: Aaron Davidson
>
> External tables are useful for creating a metastore entry that points at pre-existing
data. There is an easy workaround to use registerAsTable within SparkSQL itself, but this
is only transient, and has to be re-run for every Spark session.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message