hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasad Chakka (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-874) add partitions found during metastore check
Date Tue, 13 Oct 2009 17:37:31 GMT

    [ https://issues.apache.org/jira/browse/HIVE-874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12765162#action_12765162
] 

Prasad Chakka commented on HIVE-874:
------------------------------------

Cyrus,

I created a separate JIRA since HIVE-493 is about automatically inferring partitions during
query time and not updating metadata at all. I would like to keep that open since this may
not be sufficient for some usecases. Could you upload your patch here?

As for unit tests, check hive/ql/src/test/queries/clientpositive directory that contains the
CLI tests. One of the tests could be to create hdfs directories for a table like 'srcpart'
and run 'msck repair' on it and do a 'show partitions' on the table again to see if the partition
is listed. We need to have some unit tests so that this functionality will not be broken accidentally
by some other check-in.



> add partitions found during metastore check
> -------------------------------------------
>
>                 Key: HIVE-874
>                 URL: https://issues.apache.org/jira/browse/HIVE-874
>             Project: Hadoop Hive
>          Issue Type: Improvement
>    Affects Versions: 0.2.0, 0.3.0, 0.3.1, 0.3.2, 0.4.0, 0.4.1, 0.5.0
>            Reporter: Prasad Chakka
>            Assignee: Cyrus Katrak
>
> 'msck' just reports the list of partition directories that exist but do not have corresponding
metadata. This can happen if a process outside of hive is populating the directories. Hive
should support an option to 'msck' that would also add default metadata for these partitions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message