hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephen O'Donnell (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HADOOP-16140) Add emptyTrash option to purge trash immediately
Date Fri, 01 Mar 2019 16:31:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-16140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781849#comment-16781849
] 

Stephen O'Donnell edited comment on HADOOP-16140 at 3/1/19 4:30 PM:
--------------------------------------------------------------------

Uploaded one more patch - this contains a note in the docs about the new option and hopefully
fixes the remaining checkstyle issues.

I think adding the ability to pass a filesystem to the expunge command is quite easy as the
Trash itself has the ability to accept a non-default FS when it is created. The tricky part
will be adding a test for it I think. I will add a comment to HADOOP-13656 and see if the
current assignee wants to work on it.


was (Author: sodonnell):
Uploaded one more patch - this contains a note in the docs about the new options and hopefully
fixes the remaining checkstyle issues.

I think adding the ability to pass a filesystem to the expunge command is quite easy as the
Trash itself has the ability to accept a non-default FS when it is created. The tricky part
will be adding a test for it I think. I will add a comment to HADOOP-13656 and see if the
current assignee wants to work on it.

> Add emptyTrash option to purge trash immediately
> ------------------------------------------------
>
>                 Key: HADOOP-16140
>                 URL: https://issues.apache.org/jira/browse/HADOOP-16140
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs
>    Affects Versions: 3.3.0
>            Reporter: Stephen O'Donnell
>            Assignee: Stephen O'Donnell
>            Priority: Major
>         Attachments: HADOOP-14200.002.patch, HADOOP-14200.003.patch, HADOOP-14200.004.patch,
HDFS-14200.001.patch
>
>
> I have always felt the HDFS trash is missing a simple way to empty the current users
trash immediately. We have "expunge" but in my experience supporting clusters, end users find
this confusing. When most end users run expunge, they really want to empty their trash immediately
and get confused when expunge does not do this.
> This can result in users performing somewhat dangerous "skipTrash" operations on the
trash to free up space. The alternative, which most users will not figure out on their own
is:
> # Run the expunge command once - this will move the current folder to a checkpoint and
remove any old checkpoints older than the retention interval
> # Wait over 1 minute and then run expunge again, overriding fs.trash.interval to 1 minute
using the following command hadoop fs -Dfs.trash.interval=1 -expunge.
> With this Jira I am proposing to add a extra command, "hdfs dfs -emptyTrash" that purges
everything in the logged in users Trash directories immediately.
> How would the community feel about adding this new option? I will upload a patch for
comments.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message