spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From squito <>
Subject [GitHub] spark issue #19343: [SPARK-22121][SQL] Correct database location for namenod...
Date Tue, 26 Sep 2017 11:41:45 GMT
Github user squito commented on the issue:
    whoops, sorry I wrote [CORE] out of habit!
    > Spark SQL might not be deployed in the HDFS system. Conceptually, this HDFS-specific
codes should not be part of our HiveExternalCatalog . HiveExternalCatalog is just for using
Hive metastore. It does not assume we use HDFS.
    yes, I totally understand that.  Even for users that are on hdfs, this is clear user-error,
they should be using hive's metatool to update the database location.  Originally I thought
this would be unnecessary complication in spark, but with enough complaints I figured maybe
spark could just handle it automatically.
    Is there another place this could go instead?
    Anyway, if you really feel like this doesn't belong in spark, that is fine.


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message