hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Johan Oskarsson (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-126) Don't fetch information on Partitions from HDFS instead of MetaStore
Date Tue, 13 Jan 2009 10:09:03 GMT

    [ https://issues.apache.org/jira/browse/HIVE-126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12663286#action_12663286
] 

Johan Oskarsson commented on HIVE-126:
--------------------------------------

Since HIVE-142 is committed and the code in this ticket has been committed by accident, perhaps
it's best to just update the CHANGES file with the ticket information and close this one?

> Don't fetch information on Partitions from HDFS instead of MetaStore
> --------------------------------------------------------------------
>
>                 Key: HIVE-126
>                 URL: https://issues.apache.org/jira/browse/HIVE-126
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Metastore
>            Reporter: Johan Oskarsson
>            Assignee: Johan Oskarsson
>             Fix For: 0.2.0
>
>         Attachments: HIVE-126.patch, HIVE-126.patch
>
>
> When investigating HIVE-91 an issue came up where the information on what partitions
a table contains is loaded by listing the directories in the table directory on HDFS. This
is then used to overrule what is in the MetaStore if any difference is found. 
> * Would it not be preferable if MetaStore is the one authority on what the table contains?
> * It will also be a major hassle (or impossible?) to retrieve this information from HDFS
with external tables that have non standard partition names (HIVE-91), such as: table/2008/01/08/portugal
where "2008/01/08" is one partition value and "portugal" is another.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message