hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhe Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8898) Create API and command-line argument to get quota and quota usage without detailed content summary
Date Mon, 12 Sep 2016 21:32:21 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485346#comment-15485346

Zhe Zhang commented on HDFS-8898:

Quick note that I'm working on backporting HDFS-10744 to branch-2.7; since this change is
not in branch-2.7, the overlapping part won't be backported.

If someone plans to backport this to branch-2.7, please remember to add the optimization from

> Create API and command-line argument to get quota and quota usage without detailed content
> --------------------------------------------------------------------------------------------------
>                 Key: HDFS-8898
>                 URL: https://issues.apache.org/jira/browse/HDFS-8898
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: fs
>            Reporter: Joep Rottinghuis
>            Assignee: Ming Ma
>             Fix For: 2.8.0, 3.0.0-alpha1
>         Attachments: HDFS-8898-2.patch, HDFS-8898-3.patch, HDFS-8898-4.patch, HDFS-8898-5.patch,
HDFS-8898-6.patch, HDFS-8898-branch-2.patch, HDFS-8898.patch
> On large directory structures it takes significant time to iterate through the file and
directory counts recursively to get a complete ContentSummary.
> When you want to just check for the quota on a higher level directory it would be good
to have an option to skip the file and directory counts.
> Moreover, currently one can only check the quota if you have access to all the directories
underneath. For example, if I have a large home directory under /user/joep and I host some
files for another user in a sub-directory, the moment they create an unreadable sub-directory
under my home I can no longer check what my quota is. Understood that I cannot check the current
file counts unless I can iterate through all the usage, but for administrative purposes it
is nice to be able to get the current quota setting on a directory without the need to iterate
through and run into permission issues on sub-directories.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message