hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-12358) FSShell should prompt before deleting directories bigger than a configured size
Date Wed, 26 Aug 2015 14:53:46 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-12358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14713589#comment-14713589

Allen Wittenauer commented on HADOOP-12358:

bq.it's off by default in the patch, so compat looks satisfied

There wasn't a patch posted when I made the comment. After the data loss caused by namenode
-finalize changing in an incompatible way, I'm starting to pro-actively remind people that
ops folks build tools around our shell commands.  Changing the default behaviors of these
commands is an act of aggression against the user base, regardless of intent.

That said: IMO, I think this falls into the 'enough rope to hang yourself' area of the world.
 Between snapshots and trash, there are plenty of ways to protect against this situation.
 You can't protect the user from making every single mistake without turning the system into
a 'nanny system' that makes you verify every single thing.  All this will do is cause people
to set -Dblahblah=false or build their own delete command and continue on their way.  

Never mind that this is at the cost of three extra config vars!  Complexity, complexity, complexity...

> FSShell should prompt before deleting directories bigger than a configured size
> -------------------------------------------------------------------------------
>                 Key: HADOOP-12358
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12358
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>            Reporter: Xiaoyu Yao
>            Assignee: Xiaoyu Yao
>         Attachments: HADOOP-12358.00.patch
> We have seen many cases with customers deleting data inadvertently with -skipTrash. The
FSShell should prompt user if the size of the data or the number of files being deleted is
bigger than a threshold even though -skipTrash is being used.

This message was sent by Atlassian JIRA

View raw message