hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Koji Noguchi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-6080) Handling of Trash with quota
Date Thu, 18 Jun 2009 19:04:07 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721420#action_12721420
] 

Koji Noguchi commented on HADOOP-6080:
--------------------------------------

1) Tell users to use -Dfs.trash.interval=0 when deleting large directory
2) Exclude /user/<username>/.Trash from the quota
3) Move .Trash out of /user directory.  Maybe /Trash/<username> and set different quota.
4) When -rm/rmr fail with quota, automatically delete them.
5) Introduce a separate command that does (1).  Something like -rmr -skipTrash for force delete.


> Handling of  Trash with quota
> -----------------------------
>
>                 Key: HADOOP-6080
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6080
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: fs
>            Reporter: Koji Noguchi
>
> Currently with quota turned on, user cannot call '-rmr' on large directory that causes
over quota.
> {noformat}
> [knoguchi src]$ hadoop dfs -rmr /tmp/net2
> rmr: Failed to move to trash: hdfs://abc.def.com/tmp/net2
> [knoguchi src]$ hadoop dfs -mv /tmp/net2 /user/knoguchi/.Trash/Current
> mv: org.apache.hadoop.hdfs.protocol.QuotaExceededException: The quota of /user/knoguchi
is exceeded: namespace
> quota=37500 file count=37757, diskspace quota=-1 diskspace=1991250043353
> {noformat}
> Besides from error message being unfriendly, how should this be handled?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message