hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-16140) hadoop fs expunge to add -immediate option to purge trash immediately
Date Tue, 05 Mar 2019 14:29:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-16140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784501#comment-16784501
] 

Hudson commented on HADOOP-16140:
---------------------------------

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #16127 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/16127/])
HADOOP-16140. hadoop fs expunge to add -immediate option to purge trash (stevel: rev 686c0141eff0886c285b8e52fddade43c1ce4570)
* (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/TrashPolicyDefault.java
* (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/TrashPolicy.java
* (edit) hadoop-common-project/hadoop-common/src/site/markdown/FileSystemShell.md
* (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/Trash.java
* (edit) hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestTrash.java
* (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Delete.java


> hadoop fs expunge to add -immediate option to purge trash immediately
> ---------------------------------------------------------------------
>
>                 Key: HADOOP-16140
>                 URL: https://issues.apache.org/jira/browse/HADOOP-16140
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs
>    Affects Versions: 3.3.0
>            Reporter: Stephen O'Donnell
>            Assignee: Stephen O'Donnell
>            Priority: Major
>             Fix For: 3.2.1
>
>         Attachments: HADOOP-14200.002.patch, HADOOP-14200.003.patch, HADOOP-14200.004.patch,
HADOOP-14200.005.patch, HADOOP-14200.006.patch, HDFS-14200.001.patch
>
>
> I have always felt the HDFS trash is missing a simple way to empty the current users
trash immediately. We have "expunge" but in my experience supporting clusters, end users find
this confusing. When most end users run expunge, they really want to empty their trash immediately
and get confused when expunge does not do this.
> This can result in users performing somewhat dangerous "skipTrash" operations on the
trash to free up space. The alternative, which most users will not figure out on their own
is:
> # Run the expunge command once - this will move the current folder to a checkpoint and
remove any old checkpoints older than the retention interval
> # Wait over 1 minute and then run expunge again, overriding fs.trash.interval to 1 minute
using the following command hadoop fs -Dfs.trash.interval=1 -expunge.
> With this Jira I am proposing to add a extra command, "hdfs dfs -emptyTrash" that purges
everything in the logged in users Trash directories immediately.
> How would the community feel about adding this new option? I will upload a patch for
comments.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message