hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Casey Brotherton (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-8118) Delay in creating checkpointing Trash can leave trash for 2 intervals before deleting
Date Thu, 09 Apr 2015 23:18:12 GMT
Casey Brotherton created HDFS-8118:
--------------------------------------

             Summary: Delay in creating checkpointing Trash can leave trash for 2 intervals
before deleting
                 Key: HDFS-8118
                 URL: https://issues.apache.org/jira/browse/HDFS-8118
             Project: Hadoop HDFS
          Issue Type: Bug
            Reporter: Casey Brotherton
            Priority: Trivial


When the fs.trash.checkpoint.interval and the fs.trash.interval are set non-zero and the same,
it is possible for trash to be left for two intervals.

The TrashPolicyDefault will use a floor and ceiling function to ensure that the Trash will
be checkpointed every "interval" of minutes.

Each user's trash is checkpointed individually.  The time resolution of the checkpoint timestamp
is to the second.

If the seconds switch while one user is checkpointing, then the next user's timestamp will
be later.

This will cause the next user's checkpoint to not be deleted at the next interval.

I have recreated this in a lab cluster 

I also have a suggestion for a patch that I can upload later tonight after testing it further.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message