hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Devaraj Das (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-1943) Metastore operations (like drop_partition) could be improved in terms of maintaining consistency of metadata and data
Date Tue, 12 Apr 2011 22:14:05 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019083#comment-13019083
] 

Devaraj Das commented on HIVE-1943:
-----------------------------------

Created a reviewboard review request - https://reviews.apache.org/r/586/

The patch basically adds checks before updating metadata during operations like drop_table,
drop_database, etc. The checks are at the Warehouse layer to see whether the associated data
can be really deleted by the user in question. If the data can't be deleted then the metadata
operation is not done. 

This check is configurable and can be disabled.

> Metastore operations (like drop_partition) could be improved in terms of maintaining
consistency of metadata and data
> ---------------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-1943
>                 URL: https://issues.apache.org/jira/browse/HIVE-1943
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>
> Currently, metastore operations with associated hdfs operations like drop_partition doesn't
do a rollback if the hdfs operation fails. The metastore first updates the metadata, and then
tries to do hdfs operation. If the hdfs operation fails for any reason, the data on the hdfs
will be orphaned. We should improve the situation.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message