hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-16961) FileSystem Quotas
Date Fri, 28 Apr 2017 18:54:04 GMT

    [ https://issues.apache.org/jira/browse/HBASE-16961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15989296#comment-15989296

Josh Elser commented on HBASE-16961:

bq. As superuser I'd like to be able to do anything even if it (temporarily) violates a quota.
Of course, the namespace/table for which the quota has been violated is now less useful for
users depending on violation policy. That's fine. I'd clean that up as the last step of the
set of administrative actions underway. 

Alright. My gut reaction is that I could write some tests to investigate some corner cases
(e.g. add compression + compact a table) as a superuser. Will add a new child task for this

bq. Do we need the observer then? Make it part of core? Makes configuration simpler. I can
see this as something you'd overlook until it is too late, then apply, then have to do maybe
a lot of time consuming cleanup. 

Yeah, I like this. Can hook it into the existing global toggle for quota support. Will open
child-task as well.

> FileSystem Quotas
> -----------------
>                 Key: HBASE-16961
>                 URL: https://issues.apache.org/jira/browse/HBASE-16961
>             Project: HBase
>          Issue Type: New Feature
>            Reporter: Josh Elser
>            Assignee: Josh Elser
>         Attachments: hbase-quota-test.sh
> Umbrella issue for tracking the filesystem utilization of HBase data, defining quotas
on that utilization, and enforcement when utilization exceeds the limits of the quota.
> At a high level: we can define quotas on tables and namespaces. Region size is computed
by RegionServers and sent to the Master. The Master inspects the sizes of Regions, rolling
up to table and namespace sizes. Defined quotas in the quota table are evaluated given the
computed sizes, and, for those tables/namespaces violating the quota, RegionServers are informed
to take some action to limit any further filesystem growth by that table/namespace.
> Discuss: https://lists.apache.org/thread.html/66a4b0c3725b5cbdd61dd6111c43847adaeef7b7da5f4cd045df30ef@%3Cdev.hbase.apache.org%3E
> Design Doc: http://home.apache.org/~elserj/hbase/FileSystemQuotasforApacheHBase.pdf or

This message was sent by Atlassian JIRA

View raw message