hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Íñigo Goiri (Jira) <j...@apache.org>
Subject [jira] [Commented] (HDFS-14814) RBF: RouterQuotaUpdateService supports inherited rule.
Date Mon, 07 Oct 2019 23:22:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946330#comment-16946330

Íñigo Goiri commented on HDFS-14814:

+1 on [^HDFS-14814.011.patch].

> RBF: RouterQuotaUpdateService supports inherited rule.
> ------------------------------------------------------
>                 Key: HDFS-14814
>                 URL: https://issues.apache.org/jira/browse/HDFS-14814
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Jinglun
>            Assignee: Jinglun
>            Priority: Major
>         Attachments: HDFS-14814.001.patch, HDFS-14814.002.patch, HDFS-14814.003.patch,
HDFS-14814.004.patch, HDFS-14814.005.patch, HDFS-14814.006.patch, HDFS-14814.007.patch, HDFS-14814.008.patch,
HDFS-14814.009.patch, HDFS-14814.010.patch, HDFS-14814.011.patch
> I want to add a rule *'The quota should be set the same as the nearest parent'* to Global
Quota. Supposing we have the mount table below.
> M1: /dir-a                            ns0->/dir-a     \{nquota=10,squota=20}
> M2: /dir-a/dir-b                 ns1->/dir-b     \{nquota=-1,squota=30}
> M3: /dir-a/dir-b/dir-c       ns2->/dir-c     \{nquota=-1,squota=-1}
> M4: /dir-d                           ns3->/dir-d     \{nquota=-1,squota=-1}
> The quota for the remote locations on the namespaces should be:
>  ns0->/dir-a     \{nquota=10,squota=20}
>  ns1->/dir-b     \{nquota=10,squota=30}
>  ns2->/dir-c      \{nquota=10,squota=30}
>  ns3->/dir-d     \{nquota=-1,squota=-1}
> The quota of the remote location is set the same as the corresponding MountTable, and
if there is no quota of the MountTable then the quota is set to the nearest parent MountTable
with quota.
> It's easy to implement it. In RouterQuotaUpdateService each time we compute the currentQuotaUsage,
we can get the quota info for each MountTable. We can do a
>  check and fix all the MountTable which's quota doesn't match the rule above.

This message was sent by Atlassian Jira

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message