hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "He Yongqiang (JIRA)" <j...@apache.org>
Subject [jira] Created: (HIVE-1665) drop operations may cause file leak
Date Thu, 23 Sep 2010 01:27:33 GMT
drop operations may cause file leak
-----------------------------------

                 Key: HIVE-1665
                 URL: https://issues.apache.org/jira/browse/HIVE-1665
             Project: Hadoop Hive
          Issue Type: Bug
            Reporter: He Yongqiang
            Assignee: He Yongqiang


Right now when doing a drop, Hive first drops metadata and then drops the actual files. If
file system is down at that time, the files will keep not deleted. 

Had an offline discussion about this:
to fix this, add a new conf "scratch dir" into hive conf. 
when doing a drop operation:
1) move data to scratch directory
2) drop metadata
3) if 2) failed, roll back 1) and report error 3.1
    if 2) succeeded, drop data from scratch directory 3.2
4) if 3.2 fails, we are ok because we assume the scratch dir will be emptied manually.




-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message