spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From squito <...@git.apache.org>
Subject [GitHub] spark issue #19343: [SPARK-22121][SQL] Correct database location for namenod...
Date Tue, 26 Sep 2017 11:41:45 GMT
Github user squito commented on the issue:

    https://github.com/apache/spark/pull/19343
  
    whoops, sorry I wrote [CORE] out of habit!
    
    > Spark SQL might not be deployed in the HDFS system. Conceptually, this HDFS-specific
codes should not be part of our HiveExternalCatalog . HiveExternalCatalog is just for using
Hive metastore. It does not assume we use HDFS.
    
    yes, I totally understand that.  Even for users that are on hdfs, this is clear user-error,
they should be using hive's metatool to update the database location.  Originally I thought
this would be unnecessary complication in spark, but with enough complaints I figured maybe
spark could just handle it automatically.
    
    Is there another place this could go instead?
    
    Anyway, if you really feel like this doesn't belong in spark, that is fine.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message