hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Johan Oskarsson (JIRA)" <j...@apache.org>
Subject [jira] Created: (HIVE-126) Don't fetch information on Partitions from HDFS instead of MetaStore
Date Fri, 05 Dec 2008 16:58:44 GMT
Don't fetch information on Partitions from HDFS instead of MetaStore
--------------------------------------------------------------------

                 Key: HIVE-126
                 URL: https://issues.apache.org/jira/browse/HIVE-126
             Project: Hadoop Hive
          Issue Type: Improvement
          Components: Metastore
    Affects Versions: 0.19.0
            Reporter: Johan Oskarsson
            Assignee: Johan Oskarsson
             Fix For: 0.19.0


When investigating HIVE-91 an issue came up where the information on what partitions a table
contains is loaded by listing the directories in the table directory on HDFS. This is then
used to overrule what is in the MetaStore if any difference is found. 

* Would it not be preferable if MetaStore is the one authority on what the table contains?
* It will also be a major hassle (or impossible?) to retrieve this information from HDFS with
external tables that have non standard partition names (HIVE-91), such as: table/2008/01/08/portugal
where "2008/01/08" is one partition value and "portugal" is another.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message