hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "He Yongqiang (JIRA)" <>
Subject [jira] Created: (HIVE-1665) drop operations may cause file leak
Date Thu, 23 Sep 2010 01:27:33 GMT
drop operations may cause file leak

                 Key: HIVE-1665
             Project: Hadoop Hive
          Issue Type: Bug
            Reporter: He Yongqiang
            Assignee: He Yongqiang

Right now when doing a drop, Hive first drops metadata and then drops the actual files. If
file system is down at that time, the files will keep not deleted. 

Had an offline discussion about this:
to fix this, add a new conf "scratch dir" into hive conf. 
when doing a drop operation:
1) move data to scratch directory
2) drop metadata
3) if 2) failed, roll back 1) and report error 3.1
    if 2) succeeded, drop data from scratch directory 3.2
4) if 3.2 fails, we are ok because we assume the scratch dir will be emptied manually.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message