Mailing-List: contact hive-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hive-dev@hadoop.apache.org
Message-ID: <234925496.1228645184668.JavaMail.jira@brutus>
Date: Sun, 7 Dec 2008 02:19:44 -0800 (PST)
From: "Johan Oskarsson (JIRA)" <jira@apache.org>
To: hive-dev@hadoop.apache.org
Subject: [jira] Commented: (HIVE-126) Don't fetch information on Partitions
 from HDFS instead of MetaStore
In-Reply-To: <549315515.1228496324417.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HIVE-126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12654185#action_12654185 ] 

Johan Oskarsson commented on HIVE-126:
--------------------------------------

Forgot to ask, what's the policy for removing public methods in Hive? Release one version with them deprecated and then remove in the following release like Hadoop?
If so we could deprecate the methods and only get partition information from HDFS if it isn't an external table in the next release. Then in the following release we would remove those methods permanently. Thoughts?

> Don't fetch information on Partitions from HDFS instead of MetaStore
> --------------------------------------------------------------------
>
>                 Key: HIVE-126
>                 URL: https://issues.apache.org/jira/browse/HIVE-126
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Metastore
>    Affects Versions: 0.19.0
>            Reporter: Johan Oskarsson
>            Assignee: Johan Oskarsson
>             Fix For: 0.19.0
>
>         Attachments: HIVE-126.patch
>
>
> When investigating HIVE-91 an issue came up where the information on what partitions a table contains is loaded by listing the directories in the table directory on HDFS. This is then used to overrule what is in the MetaStore if any difference is found. 
> * Would it not be preferable if MetaStore is the one authority on what the table contains?
> * It will also be a major hassle (or impossible?) to retrieve this information from HDFS with external tables that have non standard partition names (HIVE-91), such as: table/2008/01/08/portugal where "2008/01/08" is one partition value and "portugal" is another.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.